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space  (ft,8,p) ,  where  X  is  a  non-negative  random  variable  and 
50, u)  is  a  function  defined  for  0  s  t  s  X(w)  taking  its  values 
in  some  abstract  space  X.  Let  F  be  the  distribution  of  X;  assume 
F(0)  <  1  and  F(»)  ■  1. 

Let  (n.,8, ,p, ),  i  *  1,  be  independent  copies  of  the  probabi- 

1X1  • 

lity  space  and  let  P  be  the  product  measure  defined  on  n  8^. 
Suppose  8^,  •••  is  a  sequence  of  tours  where  each 

«  (X(uj),€(t,«ij))  has  domain  and  is  chosen  in  accordance 
with  the  probability  measure  p^.  Writing  X.^  ■  XCu^),  we  see  that 
(X^  is  a  renewal  process.  We  can  construct  a  cumulative  process 
as  follows 


W(t) 


?{t,  wj,  t  S  X. 
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Suppose  (X^,Y^)  has  the  improper  distribution  G(x,y)  and 
is  a  positive  lifetime  whose  distribution  F  is  such  that  F(»)  « 
w  <  1.  Independent  vectors  (X^Yj),  ••  having  distribution 

G  are  sainpled  until  an  infinite  lifetime  is  chosen,  when  the  renewal 
process  is  said  to  "die."  Let  N(i)  be  the  number  of  lifetimes  ob¬ 
served  by  time  t  and  let  A(t)  »  1  if  Xj  <«,•••,  X^^^  <  »  and 
0  otherwise.  When  A(t)  ■  1,  define  the  Type  B  cumulative  process 
Nft) 

W(t)  *  l  Y.  . 
j-1  3 

To  ensure  W(t)  is  defined,  expectations  and  probabilities  of  interest 
are  conditioned  upon  {A(t)*l}.  Two  sharply  delineated  situations 
arise.  Although  many  standard  renewal  theoretic  results  have  direct 
analogs  in  the  first,  they  do  not  in  the  second. 

In  the  first  case,  there  is  some  o>0  making 


e0XG(dx,dy)  «  1 


and  a  new  d.f. 


[*  (Y 

G(x,y)  -  e^GCdu.dv) 

J  o 

is  defined.  Under  general  conditions  on  the  product  moments  of  G, 
E[W(t)*|A(t)»l]  is  a  kth  degree  polynomial  in  t  plus  R^Ct),  a  term 
converging  to  zero  at  a  rate  depending  upon  assumptions  about  G.  These 
same  conditions  ensure  that  the  kth  conditional  cumulant  of  W(t)  is 


Results  about  the  conditional  asymptotic  normality  of  W(t)  are 
also  obtained. 

In  the  second  case,  the  tail  of  F  is  a  function  of  slow  growth; 
a  technical  assumption  implies 

lim  P{N(t)«n|A(t)«l>  >  0 
t-*» 

and 

lim  E[N(t)k|A(t)-l]  «  cl  <  •. 
t-*»  * 

Several  examples  of  transient  cumulative  processes  are  considered 
and  the  assumption  that  each  X.  has  the  same  defect  1  - u> is  relaxed. 
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CHAPTER  1 


INTRODUCTION 


1.1  RENEWAL  THEORY 

A  renewal  process  is  a  sequence  of  independent,  identically 
distributed  positive  random  variables  X^,  X2>  ....  Let  X.^  have 

k 

distribution  function  F;  assume  F(0)  <  1  and  write  =  ^Xi  £  <*>. 
Typically,  the  X's  are  interpreted  as  waiting  times  for  some  pre- 
described  event  to  occur.  If  the  event  occurs  at  time  t,  we  begin 
waiting  all  over  again  for  the  next  occurrence,  and  the  process 
beginning  at  t  is  a  probabilistic  replica  of  the  process  which 
began  at  time  0.  . 

The  X's  could  be  lifetimes  of  pieces  of  equipment  and  the 

recurrent  event  the  failure  of  the  equipment.  At  time  0,  the  first 

piece  is  installed;  it  fails  at  time  Xj  and  is  instantly  replaced. 

Xn  is  the  lifetime  of  the  nth  piece  of  equipment  while  the  partial 
n 

sum  Sn  *  J  X^  is  the  time  of  the  nth  renewal. 
i*l  1 

Let  N(t)  be  the  integer  k  such  that  s:  t  <  S^+1.  N(t)  is  the 
number  of  events  by  time  t.  A  great  deal  of  research  in  renewal 
theory  has  centered  around  the  renewal  function  H(t)  =  EN(t),  for 
knowledge  of  the  properties  of  H  allows  one  to  answer  most  questions 
arising  about  a  renewal  process.  H(t)  may  be  written 


H(t)  -  EN(t)  •  E  l  x(Sn  *  «0  *  I  F(n)(t), 


(1.1.1 


,*> 

1 


where  ] (t)  denotes  the  n-fold  convolution  of  F  with  itself.  H 
satisfies  the  integral  equation  of  renewal  theory 


H(t)  *  F(t)  ♦  H(t-T)dF(T) 


(1.1.2) 


In  the  usual  literature,  F  is  a  proper  distribution.  That  is, 

lim  F(t)  =1.  In  this  case  the  asymptotic  behavior  of  N(t)  and  H(t) 
t-n» 

is  well  known. 

One  of  the  earliest  results  concerning  H(t)  is  the  Elementary 
Renewal  Theorem  (Feller,  (1941)),  which  states 


t  *  S’  • 


where  here  and  elsewhere  we  interpret  —  as  0  when  y,  =  ®. 

ui  1 

The  waiting  times  (X^  are  d- lattice  random  variables  if 


(1.1.3) 


l  P(X.  =  nd}  =  1 
n=l  1 


(1.1.4) 


and  d  is  the  largest  nvimber  for  which  (1.1.4)  holds.  If  the  X's  are 
lattice  random  variables,  the  renewal  process  is  discrete;  if  not, 
it  is  continuous.  In  all  the  work  which  follows,  we  shall  assume  the 
process  is  continuous.  There  is  usually  a  parallel  theorem  for  dis¬ 
crete  processes  to  any  theorem  about  continuous  processes. 

Blackwell's  Theorem  (1948)  is  an  important  generalization  of  the 
Elementary  Renewal  Theorem  for  continuous  processes.  It  states  that 
for  any  fixed  a  >  0 


H(t+a)  -  H(t)  -*  —  as  t  ■*  ®. 


(1.1.5) 


3 


Blackwell's  Theorem  was  extended  by  the  Key  Renewal  Theorem, 
proved  by  W.  L.  Smith  in  1954  and  stated  in  its  most  general  form 
in  1961. 


Key  Renewal  Theorem  (Smith  1961) 

If  F(x)  is  a  non-lattice  distribution  and  Q(x)  is  Riemann 
integrable  in  every  finite  interval  and  satisfies 


£  max  |Q(x)|  <  »,  then 
n=0  nSx^n+1 


Q(x-T)dH(t) 


i  f 

“l  Jc 


Q(x)dT  as  x  -*•» 


(1.1.6) 


(1.1.7) 


Feller  calls  functions  satisfying  the  conditions  of  this  theorem 
"directly  Riemann  integrable." 

The  Key  Renewal  Theorem  does  not  require  the  finiteness  of  any 
moments  of  F;  however,  by  asstiming  y2  <  00 *  Smith  (1954)  proved 


H(t)  -  i  =  — %  -  1  ♦  o(l)  as  t 

W1  2u/ 


(1-1-8) 


by  applying  the  theorem  to  a  judiciously  chosen  function  Q. 

The  theorem  was  instrumental  in  his  proof  that 

2 

V  W1 

Var(N(t))  =  - ^ —  t  +  o(t)  as  t  -*■  « 


(1.1.9) 


when  u2  <  ®* 

The  fact  that  the  first  two  cumulants  of  N(t)  are  asymptotically 

linear  functions  in  t  led  Smith  to  investigate  higher  order  cumulants. 

Let  C  be  the  class  of  distribution  functions  F  such  that  for  some 
(k) 

finite  k,  F  has  an  absolutely  continuous  component. 


1 
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Theorem  (Smith  1959) 

If  F  €  C  and  wn+p+j  <  ®,  p  i  0,  then  there  exist  constants 
afl  and  bn  such  that  the  nth  cumulant  of  N(t)  is  given  by 


at+b 

n  n  ci+t)P 


(1.1.10) 


where  A(t)  is  of  bounded  total  variation,  is  o(l)  as  t  -*•  ®,  satisfies 
the  condition 


A (t)  -  A(t-a)  =  o(t  )  as  t  -*•  « 


(1.1.11) 


for  every  fixed  oc  >  0,  and  when  p  £  1  has  the  additional  property 
that  belongs  to  the  class  L. . 

In  addition  to  N(t),  there  are  two  other  random  variables 
associated  with  time  which  require  our  attention.  *  sN(t)+1  ”  t 
is  called  the  forward  delay  and  represents  the  waiting  time  from  t 
until  the  next  event,  ri  =  t  -  SMf  .  is  the  backward  delay,  the 
elapsed  time  since  the  last  event.  nt  ♦  t*ie 

spanning  time  t. 

When  ®,  limiting  distributions  for  nt  and  can  be  calcu¬ 
lated  via  the  Key  Renewal  Theorem.  One  can  show  that 

ft 

=  F(t+x)  -  [l-F(t+x-T)]dH(t)  and  hence 

Jo 


lim  P{;  sx}  =  1  -  —  J  [l-F(r)]dT 
z  U1  Jx 

«  J-  f  [l-F(x) ]dx  =  K(x). 

W1  J0 


(1.1.12) 


(1.1.13) 


(1.1.14) 


The  forward  and  backward  delays  have  the  same  asymptotic  distributions 
Just  as  limiting  distributions  for  the  forward  and  backward  de¬ 
lays  can  be  derived,  there  are  asymptotic  distributional  results 

about  N(t) .  Using  the  relationship  P(N(t)2n}  *  P{SnSt},  Feller  (1941) 

2  2 

proved  that  if  <  00  and  °  3  w2  "  U1  ’  then 


P{N(t)  >  -  -  —  /tj  4(a) 
vl  ux  /  ul 


as  t  -►  ®. 


(1.1.15) 


Feller's  proof  dealt  specifically  with  discrete  renewal  processes, 
but  his  argument  can  be  extended  to  cover  the  continuous  case. 

1.2  CUMULATIVE  PROCESSES 

Cumulative  processes  are  a  natural  extension  of  renewal  processes 


A  cumulative  process  is  a  stochastic  process  built  up  from  processes 
of  random  length  called  tours  in  a  special  way.  A  random  tour  con¬ 
sists  of  an  ordered  pair  (X(u),  £(t,u>))  defined  on  a  probability 


space  (fl,8,p),  where  X  is  a  non-negative  random  variable  and 
S(*,u>)  is  a  function  defined  for  0  £  t  s  X(u)  taking  its  values 
in  some  abstract  space  X.  Let  F  be  the  distribution  of  X;  assume 
F(0)  <  1  and  F(»)  *  1. 

Let  (n. ,S^,p.),  i  *  1,  be  independent  copies  of  the  probabi- 

00 

lity  space  and  let  P  be  the  product  measure  defined  on  US.. 

i-1  1 

Suppose  8^,  6,,,  ...  is  a  sequence  of  tours  where  each 
8^  *  (X(uk ) , S(t,aK ))  has  domain  and  is  chosen  in  accordance 
with  the  probability  measure  p^.  Writing  X^  *  X(uk),  we  see  that 
{Xi>  is  a  renewal  process.  We  can  construct  a  cumulative  process 
as  follows 


W(t)  *  5(t,  u^),  t  s  Xx 

MCt) 

+  ^t-SN(t)  ,a>N(t)+l^  ’  SN(t)<tSSN(t)+r 

We  require  that  W(t)  be  of  bounded  variation  in  every  finite  t 
interval  with  probability  one  and  that  the  random  variables 

Si 

Y.  *  |  jdW(t)j  also  be  iid. 

Si-1 

Nft) 

Let  Yi  =  C(Xi,o)i);  then  W(t)  «  J  Yt  ♦  S(t-S N^,  <*Sj(t^  +  1)  • 


At  time  t  the  process  is  therefore  the  sura  of  Nft)  iid  random  variables 
plus  an  extra  piece  depending  upon  the  tour  in  progress  at  time  t. 


-  7  - 


Write  k  -  EY.  and  k  *  EY.  when  these  moments  exist.  Let 
r  x  r  1 

<j  2  =  Var(X. ) ,  o  2  =  Var(Y. ) ,  and  pw  =  Cov(X.,Y.).  Smith  (1955) 
has  shown  that 


lim  W(t)  *  —  a.s.  if  y.  <  *,  < 

t-*«  U1  11 


(1.2.1) 


1  * 
EW(t)  «  —  t  +  o(t)  if  y^  <  <  « 


(1.2.2) 


<  K  2 

Define  y=  a  2  -  2p  a  a  (— )  +  a  2(— )  .  Then 
y  xy  x  y  y^  x  y^ 


Var(W(t))  s  ~  y  *  o(t)  if  y.  <  »,*,  <  » 


(1.2.3) 


lim  P{ 

t-H» 


W(t)-<xN(t) 


w 

£a}«  $(a)  if  «2  <  «,  y^  < 


W(t)  - 


lim  P{ 

t-H» 


♦(a)  if  <2  <  «,  y2  < 


(1.2.4) 


(1.2.5) 


Equations  (1.2.2)  and  (1.2.3)  suggest  that  the  cumulants  of 
W(t)  may  be  asymptotically  linear  in  t  just  as  the  cumulants  of 
N(t)  are.  Smith  has  shown  this  for  two  special  kinds  of  cumulative 
processes.  W(t)  is  a  Type  A  cumulative  process  if 


N(t^+1 


W(t)  «  >  Yu. 


(1.2.6) 


It  is  a  Type  B  process  if 


W(t)  »  0  ,  t  <  Xx  (1.2.7) 


N(t) 

I  t  i  Xj  . 

k*l  1 


The  advantage  of  dealing  with  Type  A  and  B  processes  rather 
than  the  more  general  process 

W(t)  *  Yk  +  5(t‘SN(t)’  “Nft)*!3 


is  that  we  thereby  ^void  questions  about  the  behavior  of  the  pro¬ 
cess  between  regeneration  points. 


Theorem  (Smith  1979) 

Suppose  W(t)  is  either  a  Type  A  or  Type  B  cumulative  process. 
For  integer  n  a  1,  assume  EXj11**’*1  <  »,  E  | | n  <  •,  and 
EXjr+p|YjJs  <  «  for  rsn,  sin,  r  +  ssn+l,  and  p  i  0.  Then 
the  nth  cumulant  of  W(t)  is 


A  t  +  B  ♦ 
n  n 


H  t)  _ 

(l*t)p  ’ 


The  function  X(t)  is  of  bounded  total  variation,  is  o(l)  as  t  -*•  ®, 
and  if  p  z  1,  belongs  to  the  class  Lj. 

1.3  TRANSIENT  RENEWAL  PROCESSES 

All  of  the  quoted  properties  of  renewal  and  cumulative  pro¬ 
cesses  depend  on  the  assumption  that  list  F(x)  ■  1.  When 


lim  F(x)  *  u  <  1,  they  no  longer  hold.  We  allow  X  to  take  the  value 


x-*» 

"®"  with  probability  1  -  id  and  when  »  «  we  say  the  renewal  pro¬ 
cess  "dies"  at  time  The  probability  an  infinite  lifetime 

eventually  occurs  is 


P{X  *  ®,  some  n} 
n 


00 

l  HX  . 
n*l 


X  .  all  finite;  X  =  »} 
n-i  n 


*  (i-o»)  i  u11"1  *  i.  (i.3. i: 

n=l 

The  process  dies  with  probability  one  and  is  called  a  transient 
renewal  process  for  that  reason. 

If  Xj,  X2,  ...,  are  all  finite,  we  say  the  process  is 

"alive"  at  time  t.  Let 

A(t)  *  1  if  the  process  is  alive  at  t 

0  otherwise 

and  q(t)  *  P{A(t)  =  1}. 


q(t)  *  1  P{A(t)  ■  1,  N(t)  ■  n> 
n»0 


«  w  -  F(t)  +  f  [w-F(t-T) ]dH(x)  «u>-  (l-w)H(t) .  (1.3.2; 

J0 


As  usual,  H(t)  ■  £  F^(t)  and  the  integral  equation  H(t)  * 
n*l 

F(t)  +  H(t-T)dF(x)  is  still  true  despite  the  transient  nature  of 
J0 

the  process.  Note,  however,  that 


(1.3. 


lim  H(t)  *  T  oin  »  . 

,  1-0) 
t-t-o  n*l 

We  only  expect  to  see  renewals  before  the  process  dies. 

The  fact  that  q(t)  +  0  as  t  +  *  explains  why  the  usual  renewal 
theoretic  results  fail  to  hold  when  F  is  defective.  W(t)  cannot  be 
defined  satisfactorily  and  "asymptotic  normality"  makes  no  sense  in 
this  case.  Because  H(t)  is  not  asymptotically  linear  in  t  but  con¬ 
verges  to  a  finite  limit  instead,  a  Key  Renewal  type  result  is  not 
possible.  Rather  than  finding 

0(x)dx  , 

we  find 
x 

Q(x-x)dH(x)  -*-0  as  x  +  » 

0 

for  all  functions  Q  satisfying  the  conditions  of  the  Key  Renewal 
Theorem.  Informally,  for  large  t,  dH(t)  acts  like  "0*dt"  and  not 
like  "w1'1*dt." 

1.4  EXAMPLES  OF  TRANSIENT  RENEWAL  AND 
CUMULATIVE  PROCESSES 

1.  Time  Until  Ruin  in  Collective  Risk  Theory 

Let  the  renewal  process  (Xi>  represent  times  between  claims 
against  an  insurance  company  and  let  be  the  value  of  the  jth 
claim.  Assume  that  in  the  absence  of  claims,  reserves  increase  at 
the  constant  rate  c  >  0  and  that  the  company  has  initial  assets  u. 


f 

Jo 


Q(x-x)dH(x) 


-L  f 
“i  Jo 


The  risk  reserve  at  time  t  is 


Nft) 

R(t)  *  u  ♦  ct  -  l  Y. . 

j-1  3 


The  company  is  "ruined"  at  time  t  if  R(t)  <  0.  Define 


t  *  inf{t:R(t)<0)  (1.4.1) 


Cramer  (1955),  von  Bahr  (1974),  Siegraund  (1975),  and  others  have 
* 

studied  x  ,  the  time  of  ruin. 

Let 


N(t) 

W(t)  -  I  Y.  -  ct; 

j-1  3 


W(t)  is  a  cumulative  process  with  increments  Y^  -  cX^.  Ruin  can  occur 
only  at  some  regeneration  point  Sn  when  W(t)  exceeds  all  of  its  pre¬ 
vious  values.  Let  L^,  L2,  ...  be  the  ladder  random  variables  con¬ 
structed  from  the  increments  Y ^  -  cX . .  That  is , 


L1  • 


if  1^  is  the  smallest  integer  making  L^  positive.  For  n  »  2,  3,  ..., 


L 


n 


I 

k«I  +...+I  +1 

1  n-i 


<vcv 


where  1^  is  the  smallest  integer  making  Lr  positive.  L^  is  the  sum 
of  I  iid  random  variables;  the  L's  are  iid  because  the  I's  are. 


Associated  with  the  L's  is  the  renewal  process  {Z^}, 


Zj  ■  l  \ 
1  k-1  K 


I  +  •  .  .  +  J 

1  n 

Z  -  l  X. 

n  k»I.+‘*«+I  .+1  ** 

i  n-i 


n  *  2,  3, 


Let  M(t)  be  the  renewal  count  for  the  process  {Zi }  and  let 


MCt) 

"z(t>  *  t  ^ 

k»l 


be  the  increasing  cumulative  process  built  from  the  ladder  variables. 


*  MIt) 

P{t  it}  ■  P{  l  L.  >  u}.  (1.4.2) 

k*l 

n 

If  E(Y^-cX)  <0,  £  (Y^-cX^)  attains  a  maximum  with  probability 

k=l 

one  and  then  drifts  toward  -®.  This  means  {Z^}  and  W^(t)  are  transient 
processes.  In  Chapter  4  we  will  suggest  a  way  of  coping  with  (1.4.2); 
our  results  and  methods  are  similar  to  those  of  von  Bahr  and  Sieg- 
mund. 


2.  Waiting  Times  for  Long  Gaps 

Suppose  the  renewal  process  {X^}  is  stopped  at  the  first 
appearance  of  an  interval  longer  than  L  which  is  free  of  renewals. 
Let  F  be  the  proper  distribution  of  the  X's  and  define  W  to  be  the 
waiting  time  for  such  an  interval.  Let  V(t)  »  P{W  s  t}.  V(t)  ■  0, 
t  s  L.  For  t  >  L,  the  event  {W  s  t}  can  occur  in  one  of  two  ways. 
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Either  X^^  itself  exceeds  L  or  Xj  s  L  and  the  search  for  a  long  gap 
begins  again  from  the  new  starting  point  Xj  and  the  event  (Kit-  X^l 
occurs .  Thus 


V(t)  *  l-F(L) 


+ 


rL 

V(t-T)dF(T),  t>L. 

Jo 


(1.4.3) 


We  can  write 


V(t) 


v(t)  ♦ 


ft 

V(t-T)dG(t) 

J0 


(1.4.4) 


where  G  is  a  defective  distribution  defined  by 

G(t)  -  (  F(t),  t  S  L 

l  F(L) ,  t  >  L 

and 

v(t)  *  {  0  i  t  U 

l  l-F(L) ,  t  >  L. 

Hence 

V(t)  *  v(t)  ♦  j  v(t-T)dHG(x) . 


(1.4.5) 


Feller  (1971)  uses  the  notion  of  waiting  for  a  large  gap  to 
model  the  problem  of  a  pedestrian  trying  to  cross  a  stream  of  traffic. 
Let  the  renewal  process  {X^}  be  the  gaps  between  successive  cars. 

In  order  to  cross  the  street  with  safety,  the  pedestrian  must  wait 


for  a  gap  of  more  than  L  seconds,  say.  The  distribution  of  his 
waiting  time  is  given  by  (1.4.5). 

V(t)  may  also  be  interpreted  as  the  probability  that  the  maxi¬ 
mum  lifetime  or  partial  lifetime  observed  by  time  t  exceeds  L. 
Lamperti  (1961)  has  studied  the  problem  from  this  point  of  view. 

3.  Lost  Telephone  Calls 

Suppose  that  calls  arriving  at  a  telephone  trunkline  form  a 
Poisson  process  with  intensity  X.  A  call  is  placed  at  time  0.  The 
lengths  of  conversations  are  independent  random  variables  with  common 
distribution  F.  Calls  arriving  during  a  busy  period  are  lost;  we  are 
interested  in  the  waiting  time  W  for  the  first  lost  call.  We  may 
consider  the  renewal  process  {X^}  where  is  the  time  between  the 
i-lst  and  ith  calls  so  long  as  no  calls  arrive  during  the  busy  period 
caused  by  the  i-lst  call;  otherwise  Xi  *  ®  and  the  process  stops. 

The  busy  periods  associated  with  the  process  have  distribution 

G(x)  «  [  e'XTdF(T).  (1.4.6) 

J0 

The  event  (X^sx)  occurs  when  the  call  begun  at  time  0  lasts  for  some 
time  t  s  x  and  a  new  call  is  received  in  the  remaining  time  x  -  t. 
Hence 

J(x)  -  P(X  Sx)  *  f*  (l-e'X(x'T)]e‘XtdF(T)  (1.4.7) 

J0 


lira  J(x) 


f  e"XTdF(T)  *  F*(X)  -  u  <  1. 


(1.4.8) 
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We  can  study  W,  the  waiting  time  for  the  first  lost  call,  by 
studying  the  transient  process  {X^} .  Let  q(t)  be  the  probability 
the  X  process  is  alive  at  time  t. 

P{W>t}  ■  q(t)  -  u  -  (I-uOHjU)  (1.4.9) 

by  (1.3.2).  Of  course,  we  know  that  P{W>t)  +  0  as  t  +  •,  but  it 
would  be  interesting  to  know  the  rate  of  this  convergence.  Results 
obtained  in  Chapters  3  and  4  address  this  question.  This  example  is 
from  problem  17,  Chapter  6.13  of  Feller  (1971). 

4.  Generalized  Type  II  Geiger  Counters 

Particles  arriving  at  a  generalized  type  II  Geiger  counter 

constitute  a  Poisson  process  with  intensity  X.  The  nth  particle 

locks  the  counter  for  a  time  T  and  annuls  the  after-effects  of  all 

n 

preceding  particles.  Suppose  the  T’s  have  common  distribution  B 
and  let  be  the  length  of  the  ith  locked  period.  Define  Z(t)  = 
P{Yj>t}.  The  event  {Yj>t}  can  result  either  because  T^  >  t  and  no 
particles  arrive  in  (0,t]  or  because  a  particle  arrives  at  some  time 
t  <  Tj,  x  s  t  and  the  locked  period  begun  at  x  exceeds  t  -  x.  Thus 

Z(t)  «  e“Xt(l-B(t)3  +  f  Xe"XT [l-B(x) ]Z(t-x)dx.  (1.4.10) 

J0 

We  may  regard 


(1.4.11) 


as  a  defective  distribution  and  write 


Z(t)  *  e 


-Xt 


Z(t-T)dF(T) 


(1.4.12) 


which  implies 


Z(t)  *  e'Xt[l-B(t)]  ♦ 


*  e‘X(t'T)[l-B(t-T))dHF(T). 


(1.4.13) 


To  investigate  the  distribution  of  the  locked  periods,  we  must  deal 
with  the  transient  renewal  function  Hp(t).  Also,  if  we  are  interested 
in  the  renewal  process  {X^}  where  represents  the  time  between  the 
beginning  of  the  i-lst  and  ith  blocked  periods,  we  see  that 


p{x  sx}  *  Xe'Xt[l-Z(x-T)]dT  (1.4.14) 

1  J0 

because  X^  is  the  sum  of  the  length  of  a  locked  period  and  the 
waiting  time  for  the  arrival  of  the  first  particle  after  the  counter 
has  become  unlocked.  Study  of  {X^}  requires  coping  with  F  and  Hp. 

This  example  is  from  problem  15,  Chapter  11.10  of  Feller  (1971). 

5.  Age  Dependent  Branching  Processes 

A  particle  bom  at  time  0  lives  some  random  time  and  then  splits 
into  k  new  particles  with  probability  q^,  k  =  0,  1,  ....  Its  life¬ 
time  has  distribution  G;  assume  G(0+)  =  0  and  G(®)  =  1.  The  new 
particles  develop  independently  of  one  another  and  of  their  time  of 
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birth;  they  have  the  same  lifetime  distribution  and  splitting  proba¬ 
bilities  as  the  first  one. 

Let  Z(t)  be  the  number  of  particles  at  time  t  and  pr(t)  = 

P{Z(t)  =  r}.  If  Z(t)  =  0,  then  Z(t+s)  =  0  for  all  s  £  0;  the 
branching  process  becomes  extinct.  Define  the  generating  functions 

00  00 

h(sD  =  I  qs11  and  F(s,t)=  £p(t)sr.  (1.4.15) 

n=0  n  r=0 

Bellman  and  Harris  (1948)  initiated  the  study  of  age  dependent 
branching  processes  and  derived  the  equation 

ft 

F(s,t)  =  h[F(s,t-y) ]dG(y)  ♦  s[l-G(t)].  (1.4.16) 

J0 

Levinson  (1960)  proved  that  (1.4.16)  has  a  unique  solution 
F(s,t)  which  is  a  generating  function  for  each  t  and  is  the  unique 
bounded  solution. 

To  investigate  A(t),  the  expected  number  of  particles  at  time 
t,  suppose  a  -  h'(l)  <  ®. 

A ( t )  =  =  af  A(t-y)dG(y)  +  1  -  G(t) .  (1.4.17) 

3S  s=l  J0 

Bondarenko  (1960)  has  shown  that  if  a  £  1,  PqC^)  4  1  as  t  ■*■  *. 
That  is,  the  process  becomes  extinct  with  probability  one.  In  parti¬ 
cular,  consider  the  case  a  <  1.  We  may  regard  aG(y)  as  a  defective 
distribution  with  corresponding  renewal  function  H^fy).  Hence 


A(t)  =  l-G(t)  + 


G(t-T)]dHa(t). 


(1.4.18) 


Depending  upon  our  assumptions  about  the  tail  of  G,  we  can  find 
different  asymptotic  estimates  of  A(t)  by  using  the  results  of 
Chapters  3  and  4.  These  estimates  agree  with  those  of  Vinogradov 
(1964)  and  Chistyakov  (1964). 

To  study  Pp(t)  and  u(t)  *  l-pg(t),  we  need  only  notice  that 
pQ(t)  =  F(0,t).  Thus  equation  (1.4.16)  yields 


P0(t)  - 


h[p0(t-y)]dG(y) 


(1.4.19) 


Vinogradov  and  Chistyakov  have  derived  asymptotic  expressions  for 
u(t)  from  (1.4.19)  by  expanding  h  in  a  power  series  around  1  and 
applying  methods  like  those  we  will  discuss  in  Chapters  3  and  4. 


CHAPTER  2 


PRELIMINARY  RESULTS  ON  TRANSIENT  PROCESSES 

2.1  INTRODUCTION 

Our  goal  is  to  develop  a  theory  for  transient  renewal  and  cumu¬ 
lative  processes  which  parallels  that  for  standard  renewal  and  cumu¬ 
lative  processes.  To  ensure  that  it  makes  sense  to  talk  about  the 
behavior  of  a  transient  process  at  time  t,  we  will  condition  expecta¬ 
tions  and  probabilities  of  interest  upon  (A[t)  =1}.  We  will  study 
questions  of  the  following  type: 

1)  Does  P{A(t+s)  *  1 ( A(t)  *  1}  have  a  limit  as  t  +  «? 

2)  Do  P(5tSx|A(t)  *1}  and  P{nt*xjA(t)  =1}  have  limits  which 
are  proper  distributions  in  x? 

3)  Is  E[W(t)  |A(t)  *  1]  asymptotically  a  kth  degree  poly¬ 
nomial  in  t? 

4)  Is  W(t)  conditionally  normal? 

A  brief  examination  of  several  of  these  questions  will  indicate 
the  types  of  expressions  we  must  cope  with  if  we  are  to  answer  these 
queries  satisfactorily. 

Notice  that 


q(t+s)  _  H(»)  -  H(t+s) 
q(t)  "  H(»)  -  H(t)  • 


P{A(t+s) |A(t)=l} 


It  is  not  difficult  to  derive  the  conditional  distribution  of 


the  backward  delay.  We  have  that 


Pirrsx,  A(t)=l}  =  l  P{ntsx,  A(t)  =1 ,  N(t)*n) 
n=0 


=  U(x-t)  [oi-F(t) ]  l 

n=l 


[oj-F(t-x)  ]dF^  (x) 


t-x 


*  U(x-t) [u)-F(t)]  + 


[u)-F(t-x)  ]dH(x) 


t-x 


Therefore 


U(x-t)  [ui-F(t)  ]  + 


P{ntsx|A(t)«l}  = 


[oi-F(t-x) ]dH(x) 


t-x 

(1-0))  [H(°°)  -H(t)  ] 


(2.1.1) 


Taking  W(t)  *  N(t)  and  k  *  1  in  question  3  leads  us  to  investi¬ 
gate  E [N(t) | A ( t )  =  1].  But 


EN(t) A(t)  -  E  l  x(Sst,  A(t)-l) 


n=l 


-  I 

n=l 


:(n) 


r  t 


q(t-x)dFk  ' (t)  =  q(t-x)dH(x) 
0  J0 


Hence 


EtN(t)|A(t)-I]  .  f 


(2.1.2) 


These  examples  demonstrate  that  to  answer  the  questions  posed 
we  must  study  F(«)-F(t),  H(«)-H(t),  and  their  relationship. 
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2.2  THE  TAIL  OF  H 

We  begin  with  a  helpful  lemma. 

Lemma  2.1 

q(t*s)  s  q(t)q(s)  for  all  t,s  >  0. 

Proof : 

Let  Gt(x)  «  P{?tsx} 

q(t+s)  *  P{A(t+s)=l)  *  P{A(t+s)*l, Ct^s}  ♦  P(A(t+s)=l, ct>$> 

*  [  q(s-u)dG  (u)  +  P{A(t+s)  *  1,  c  >s) 

Jo  z 

2  RCs)[Gt(s)  +  P(A(t)  »  1,  ;t>s}]  *  q(s)q(t) .  □ 

It  is  well  known  (see,  for  example.  Chapter  1  of  Galambos  and 
Kotz  (1978))  that  if 


<Hs)  =  lim 

t-H» 


exists,  then  either 


«  OS 

(i)  iji(s)  *  e  for  some  a  >  0  or 
(ii)  0 (s)  is  either  0  or  1  for  all  s  >  0. 

In  fact,  Lemma  2.1  shows  that  in  case  ii),  i|/(s)  =  1  because 
Ks)  *  q(s)  >  0. 


If  lim  ■_377T^'  *  1  f°r  aH  fixed  s,  f  is  called  a  function  of 

t-*»  * 

moderate  growth.  All  such  functions  have  the  property  that 

f(t)  ~  k  exp  {(  o(u)du}  (2.2. 

J0 

where  a(u)  -*•  0  as  u  -►  «.  See  Smith  (1972) . 

Hence  if  <Ks)  exists,  either  H(*)-H(t)  or  eat[H(«)-H(t)]  is 
a  function  of  moderate  growth.  When  case  i)  obtains,  if  we  fix 
e  >  0,  there  is  a  T(e)  such  that 

eot[H(«)-H(t)]  <  eet  for  all  t  2  T. 

Thus  if  we  choose  any  0  <  c  <  a  and  fix  c  <  a  -  c. 


c 


ect[H(«)-H(t)]dt 


[T  ect[H(-)-H(t)]dt  ♦  f  e'(a'c'e)tdt 
J0  ■'T 


<  » 


(2.2. 


This  ensures  that  both  H  and  F  have  moments  of  all  orders. 

We  shall  see  in  Chapter  4  that  a  is  an  important  constant  and 

r° 

!  e  xdF(x)  sl.  If  the  equality  holds,  we  can  salvage  many 
J0 

standard  renewal  theoretic  results  by  conditioning  arguments.  How¬ 
ever,  if  the  inequality  is  strict,  much  less  can  be  proved.  But 
regardless  of  whether  F*(- a)  8  1  or  F*(-  a)  <  1,  we  have  the  following 
lemma. 


Lemma  2.2 

Suppose  4>  is  an  integrable  function  on  [0,x].  If  ^yrv  e 


then 
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lim 
t-M»  J  t-x 


L 


fx 


e^fyidy 


(2.2.3) 


v 


Proof: 


Establish  a  partition  of  [t-x,t]:t-x  3  y^  <  y^  <• 


-  •  <  v  3  t . 


Let  min  ♦(t-t)  ■  $ 


y.StSy.  . 


-J 


max  <Ht-T)  ■  $. 


yjSTS/j+l 


J 


v  *  .  r  ♦(t-x? 

>n  £3  H(-)  -  H(y,5  (1-«)(HW-H(t))  Jt_x  q(t) 


j*0 


dH(r) 


y 


Y  H(y.^)-H(y.) 
ji0  9j  H(«) -  H(y.) 


H(-)  -  H(y.) 
(1-u)  (H(*>)  -H(t) ) 


As 


H(-)-H(y.) 

H(-)-HCt) 


o(t-y.) 

»  J 


and 


HW-H&j)  ‘  * 
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* 

i 

-» 

, 


this  convergence  is  uniform  since  t  -  x  s  y.  s  t.  Thus  for  any 
e  <  0,  we  can  choose  t  to  be  large  enough  to  make 

1  N=1  "0(yi+ryi)  ff(t'yi>  fz  *ft-T) 

l  tjtti-e  >*1  Me  «tt) 

1  j»0  J  t-x  41  ; 


N-l  _  -0(y  -y.)  o(t-y.) 

5  fliJ  I  ♦jUl-e  11  J  ]e  +  «>• 

j«0  J 

Letting  the  mesh  of  the  partition  approach  zero  and  noting  that 
'Hy)e°y  is  necessarily  integrable  on  [0,x],  we  conclude 

lim  [  <Kt-x)dH(x)  ■  [  ♦  (t-T)e°^t>T^dT 

t~  Jt-x  1"W  t-x 


i?s  L 


Corollary  2.1 


q(t+s)  -os  ^ 

If  -  e  ,  then 


lim  P(n  Sx| A(t) *1}  -  [  [a-FfyDle^dy  i  J(x)  .  (2.2.4) 

t-x»  *  J0 


Proof: 

From  (2.1.1),  we  have 


P{nt«x|A(t)-l) 


U(x-t)  [u>-F(t)]*f  [w-F(t-x) ]dH(t) 

Jt-x 


q(t) 


The  result  follows  directly. 
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Corollary  2.2 


then 


-CX  rX 

lim  P{5  Sx|A(t)-l>  -  2«_  e^fl-Ffy)  ]dy  5  L(x).  (2.2.5) 

J  n 


Proof: 


P{Ctsx,A(t)«l)  «  l  P{;  £x,A(t)»l,N(t)=n} 


n*0 


to  .£ 

F(t+x)  -  F(t)  +  J  [F(t+x-x)-F(t-x)]dF(n)(x) 
n=l  •'0 


F(t+x)-F(x)  + 


t+x 


rt+x 


F(t+x-x)dH(x) 


F(t+x-x)dH(x) 


ft 


F(t-r)dH(T) 


F(t+x)-F(t)+H(t+x)-F(t+x) 


t+x 


F(t+x-x)dH(x)-H(t)+F(t) 


rt+x 


[l-F(t+x-x)]dH(x) . 


Therefore 


P(StSx|A(t)=l} 


•t+x 

'x 


[l-F(t+x-x) TdH(x) 
q(t) 


(2.2.6) 


rt+X 

lim  P(i  Sx|A(t)*l)  *  lim 
t-+"  t-*-»  ^  t 


[l-F(t+x-x) 1dH(x)  q (t+x) 
q(t+x)  q(t) 
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at 


-ox 


1  -  ft> 


e^tl-Ftyndy. 

0 


We  can  rewrite  the  limiting  distribution  as 


□ 


L(x)  «  (l-ft))"1{l-ft)-e'0X+  e“ox  f  e^dFCyJ-HD-FCx)}.  (2.2.7) 

J0 

It  is  worth  noting  that  J  and  L  are  distinct  distributions.  In 
proper  renewal  theory,  the  forward  and  backward  delays  share  the  same 
limiting  distribution.  In  the  transient  setting,  however,  nt  is 
asymptotically  greater  in  distribution  than 

Lemma  2.3 

L(x)  2  J(x)  for  all  x  2  0. 

Proof : 

eaxdF(x)  s  1,  we  have 


Using  the  fact  that 


r 

Jo 


i  “ox  ^  -ax.  r 
1-e  2  (1-e  )  { 


rx 


OZ 


l 


eu“dF(z)  ♦  eazdF(z) } 


-OX.  cz 


f 

J0 


2  (l-eu~)  |  eUfcdF(z)  +  J  (eUA-l)dF(z). 

'  x 


ox 


Thus 


,  -ox  -ax 
1-e  +  e 


a  z 


e““dF(z)  ♦  ft>-F(x)  2  |  eazdF(z)  ♦  I  eWAdF(z) 


r 


.ox , 
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fX 

<*>  l-e~ox  ♦  e’ox  e0ZdF(z)  ♦  a>-F(x)  2 
J0 

0  f  f  e^dy  dF(z)  ♦  of  f  eaydy  dF(z)  ♦  u 
J 0  -*0  'x  ■'0 

<«>  i-u-e"ax  ♦  e"ax[X  eazdF(z)  ♦  w-F(x)  a 

*'0 

of  P*  e^dFCzidy  *o[  e0^ [u>-F(y) ]dy. 

J0  Jy  JQ 

From  (2.2.4)  and (2. 2. 7),  we  see  L(x)  z  J(x).  □ 

Much  of  proper  renewal  theory  draws  heavily  upon  the  fact  that 
H(t)  *  EN(t)  is  asyratotically  linear  in  t.  In  the  transient  situation, 
if  H(«)  -  H(t)  is  a  function  of  moderate  growth,  conditioning  on 
(A(t)  *  1}  will  not  help  us  develop  an  analogous  theory.  This  is 
because  E[N(t)|A(t)  *  1]  is  not  asymptotically  linear. 

Lemma  2.4 

If  H(«)  -  H(t)  is  a  function  of  moderate  growth,  then 
E[N(t)|A(t)»l] 


Proof : 

From  (2.1.2)  we  have 


E[N(t)  |A(t)-l]  -  J*  aI^TldH(T). 


We  now  turn  to  the  relationship  between  the  moments  of  F  and 
H  and  between  the  rates  at  which  the  tails  of  F  and  H  approach  0. 
Let  x^dF(x)  s  •  and  *  J  x^dH(x)  S  •. 

The  integral  equation  of  renewal  theory  yields  a  simple  rela¬ 
tion  between  the  Laplace-Stieltjes  transforms  of  F  and  H. 


Leona  2.5 


H  and  F  have  the  same  number  of  finite  moments. 


Proof: 


xkdH(x)  <  «  ->J  xkdF(x)  <  »  . 


r"  k  Jk 

Suppose  xKdF(x)  <  ».  Then  — r-  F*(s)  exists  and  is  finite  for 
J0  dsK 


s  a  0.  Hence 


4„.(s).  I  6  F*(s)  T7  I—5 - 1 

ds  j*0  3  dsJ  ds  •’  1-F*(s) 


(2.3.1) 


exists  and  is  finite  for  s  ^  0.  (Note  that  F*(s)  s  <  l  for 
s  2  0.)  Therefore 


— —r*  H*  (s)  *  (-l)kv  is  finite. 

ds  s=0 


From  expression  (2.3.1),  we  see  that  v  is  a  linear  combination 

m 

of  terms  like  cu.  •••  u.  where  £  k  =  k.  In  fact, 
k.  k  n 

1  ra  n=l 


*  - j  +  terms  involving  products  of  lower  order 

(1-w)  moments  of  F. 


Because  of  this  form,  one  might  expect  that  if  =  ®,  then 


fx  r 

yr[H(«)-H(y)]dy 

j_0 _  x  1 

X  yr[F(»)-F(y)]dy  (1'u° 

Jn 


We  will  show  that  this  is  indeed  the  case. 
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We  begin  with  a  variation  on  Feller's  (1963)  ratio  limit 


theorem. 


Theorem  2.1 

Let  a(x)  and  b(x)  be  non-negative  and  non-increasing  functions 
of  X£[0,»)  and  define  $(x)  =  xka(x)  and  i|»(x)  =  xkb(x),  k  >  0. 
Suppose  ♦°(s)  and  ti>°(s)  exist  for  all  s  >  0.  Then  if  we  write 


•x  ,x 

=  4>(y)dy  and  ’i'(x)  *  <Ky)dy, 

j0 


a  as  x  if  and  only  if 


n  -  ■■■■  +  a  as  s  +  0  (o  <  ®) . 

As) 


Proof  I : 


Assume  ■*  a  as  s  ■*  0 .  Define 

As) 


4>^(x)  *  e  ti»(tx)_  .  ^Cj.^  _  [ 

Ac/t)  t  Jn  z 


^(x)  «  .  T®(X) 

Ac/t)  * 


j  Ay)<iy- 
Jo 
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Then  there  is  a  sequence 

*(t.) 

{t.}  +  ®  such  that  t ^  -*•  X  . 

1  ¥(tj) 


By  Helly’s  Selection  Theorem,  3  a  subsequence  {t.  }  such  that 

■*n 


*t  (x)  "  FjCx)  and  ^  (x)  *  F2(x) 


where  and  F,  are  nondecreasing  right  continuous  functions 
bounded  between  0  and  1.  The  continuity  theorem  for  Laplace 
transforms  implies 


c°  0  c°  0 

*t.  (S)  -  Fl(s)  and  ft.  (S)  "  F2CS) 


Upon  calculating  transforms,  we  see  this  means 


Ap 

_ 

s*°Cp 

J. 


Ap 

F?(s)  and  -07T- 

(— ) 

^n 


F°(s) 


(2.3.2) 


We  want  to  be  sure  that  F^(s)  and  F2°(s)  are  strictly  greater  than 
zero  for  all  s  >  0. 

Note  that 


e  7t.  y  a(t .  y)dy 

<  (x,  .  ^ -  "  n 

j  -cy^k+1  k  , 

Jn  e  7t.  y  a(t  y)dy 

n  Jn  Jn 


This  is  strictly  positive  for  sufficiently  large  x. 


Therefore  F^x)  >0  for  all  large  x  and  hence  F^(s)  >  G  for 
all  s  £  0.  By  exactly  the  same  argument,  F^Cs)  >  0  for  all  s  £  0 
From  (2.3.2)  we  see 


0,c+s.  .0,  c  . 

♦  C— )  *  (— ) 


3 


n 


3, 


.O.c+s^  ,0.  c  . 

t  (■£ — )  — ) 


3, 


'n 


F1°(s) 

F2°(s) 


But  by  assumption,  the  product  of  these  factors  converges  to  1  as 
t .  ■*<*>. 
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It 


S 


P 


Hence  F^s)  =  F2°(s)  =  F°(s). 

Let  z  >  1  be  a  continuity  point  of  F(x) 


$t.  (z) 

^n 


t.  (z) 
Jn 


“►  1  . 


And 


(z) 

^n 

**  (z) 

jn 


_ ^n_ 

,0,  c  , 

— •) 

^n 


«  ; 


i  .e. , 


t  z 


e‘cyt.  0(t.  y)dy 


-*n  -’n 


rz 


a 


e"cyt.  4>(t,  y)dy 


Jn  ^n 


Thus 


rl 

e"cyt .  d> (t .  y)dy 

■’0  Jn  ■'n 

lim  -  <  a 


n-*» 


e"cyt  4>(t .  y)dy 
Jn  Jn 


e”C  (  t.  4> (t  y)dy 
tt—  '0  Jn  ^n 


lim 

n-*» 


rz 


s  a 


t  ili  f  t  vl  Hv 


Then 
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lim 

n-H*> 


t. 

_cf  3n 

e  $(u)du 

J0 


z 


ip  ( zu)  du 


£  a 


I  im 
n-*» 


t. 

_cf 

e  <Ku)du 

Jq _  £  a 

t. 

Jc-lf  n  uSf  zu)du 


0 


lim 

n-*» 


t. 

J 


•  'n 
•  n 


<Ku)du 


t. 

r  ■’n 


_  c  k+1 
£  e  z  a 


uS(u)du 


*>  X 


.  c  k+1 
£  e  z 


a. 


But  c  is  arbitrary  and  z  is  arbitrarily  close  to  1.  Therefore 
X  £  a.  By  reversing  the  roles  of  $  and  '?  we  will  find 


lim 

t-*» 


nt) 

*(t) 


£  a 


2  a. 


lim 

t-x*> 


Oil  , 

Y(t) 


a. 


Hence 


Proof  II: 


We  now  assume  that  lim 

x-*» 


$(x) 

'S'(x) 


Let 


.0, 

lim  *  X  s 

s4-0  Cs) 


Let 


{t.}  +  «  be  such  that  — r- 

J  *0(& 

3 


2-  +  x. 


We  can  select  a  subsequence  (t^  }  such  that 


'n 


Hxtj  )  f(xt^  ) 

*(t.  )  Fl^x)  and  ¥~(t.  )  *  *VX^ 
Jn  3n 


for  0  s  x  s  1 


(2.3.31 


because  $£X£j  and  ^x*j  are  d.f's  on  [0,1].  Let  x  be  a  continuity 
point  of  both  Fj  and  F2> 


Fj(x) 

FjTx) 


lim 

n-*» 


®(xt.  ) 
Jn 

?(xt  ) 
Jn 


V(t.  ) 
Jn 

*(t.  ) 
Jn 


1. 


Thus  F, (x)  =  F-(x)  =  F(x). 
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We  want  to  be  certain  that  F  (s)  >0.  Note  that 


*  ■  c 


k  fx  1  k**'  k  v 

yKa(y)dy  *  J  (j)  v  a(y)dv  * 


.  k+1  tX  .  ,  K  +  i 

(j)  J  v  a(v)dv  =  (j)  4>(x) 


♦(41) 

Ui"  TftTT  * 

n->»  v  j 

n 


(j)  .  Hence  F  (s)  >  0. 


By  the  continuity  theorem. 


e~cxd$(xt .  ) 
Jn 


'  0  *<*1 


F*(c) 


e’cxd*t'(xt .  ) 
^n 


0  *t*j  > 

J  n 


and  their  ratio  converges  to  1.  Thus  we  see 


f*  -cxk 
e  t . 

jo _ l 

f1  -cx  k 
e  cxt . 

•  n  J 


k+1  k  , 

x  a(xt.  )dx 

3  J 

Jn  Jn 


k+1  k,  ,  ^  ,  , 

.  x  b(xt .  )dx 

Jn  Jn 


*(t,  ) 
Jn 

nt.  ) 

J  n 


(2.3.4) 
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Consider 


!  e’CX  xka(xt  )dx  «  f  e"cxxka(xt.  )dx  +  f  f 
J0  3n  J0  Jn  m=l  i 


<*  2m+1 

I  [  e  cxxka(xt.  )dx . 
i=l  2m  3n 


e'cxxka(xt  )dx  =  e"2  cu(2k+1)muk  a(2mut.  )du 

>ra  3  J1  Jn 


s  C2k-l^m  f2  e-[2m-l]cVcu  uk  a(ut  )du 

Jn 


2m- 1  ]  c  f  2 
31 


,  (2k*l3»  e-[2  -l]c  f  e-cu  uk  a(ut.  )du. 

jl  3n 


-cu  k  . 
e  u  a(ut 


rl 

.  )du  = 

3n  Jl> 


-2cu0k+l  k 

e  2  u  a(2ut.  )du 
3n 


<  2^+1  »"c/2  f  "cu  k  f  . 

s  2  e  e  u  a(ut.  )du 

J 1/2  3n 


s  2k*le-c/2f  ,-cu  ukJ(ut  )<lu 
Jo  3n 


e  x1'  a(xt .  jdx  s 

*  0  ^  n 


e"cx  xk  a 


(xt.  )dx{l  *  2k*1e'c/2[l  *  l  (2k*1)V[2'"'llc] 
Jn  m»l 


-cx.k+1  k  ,  .  , 

t,  e  t.  x  a(xt.  )dx 

_ ^n_  s  >0  Jn  Jn 

P° e~c5ctk+I  xk  b(xt.  )dx 
^n  '0 


1  -cx  k 

a,  e  cxx  a(xt.  )dx 

^  {1  ♦  2k+1e"c/2[l+  l  (2k+1)V[2  -1]c]>  ^ - in 

"-1  fe'cxxkb(xt. 

Jo 


From  (2.3.4),  we  conclude 


X  s  (1  +  2k+1e'c/2[l  ♦  l  (2k+1)V^  -1^C])a. 

m=l 


By  letting  c  -*•  ®,  we  see  X  s  a. 

Reversing  the  roles  of  $  and  <l>,  we  will  discover 


lim  2  a  and  the  conclusion  follows. 

s-*0  <|>  (s) 


In  order  to  apply  Theorem  2.1,  we  derive  a  relation  between 


the  tails  of  H  and  F. 


H(t)  »  F(t)  ♦  F(t-T)dH(T) 

J0 

«>  H(-)-H(t)  »  F(-)-F(t)  *  -  f  F(t-r)dH(t) 


F(»)-F(t)  ♦  u[H(»)-H(t)+H(t)]  -  Z  F(t-T)dHCT) 


(1-w)  [H(°°)-H(t)  ]  -  F(»)-F(t)  ♦  P [oj-FCt-x)  JdHCT) 

J0 

and  hence 


Cl-oO  e-5  i(H(“) -H(t) ]dt 


«  f  e'St[F(«)-F(t)]dt  ♦  f  f  e'st[F(»)-F(t-T)ldHCT)dt 

■>0  Jo  Jo 

-  I"  e‘st[F(-)-F(t)]dt  *  j  e"St  pe’S (t'x)  [F(«) -F(t-x]dtdH(r) 


Therefore 


a.)  r 

J0 


e”  [H(-)-H(t)]dt 


.{j  e’st[F(»)-F(t)]dt}  {1  ♦  J  e‘stdH(x)} 

•'0  J0 


C2.3.5) 


•>  lira 
s->0 


f  «"St[H(»)-H(t) ]dt 

Jo 


e'St[F(«)-F(t)]dt 


(!-»)' 


(2.3.6) 


This  is  true  regardless  of  whether  F  and  H  have  finite  first  moments. 


Suppose  un  <  <*>  but  yn+1  *  *  (n*0,  1,  ...).  Then 


rv  n 


-St 


(1-a,)  j  t  e  [H C00) -H(t) ]dt 


0 


(!■<*>)  ( 


.  V  f 

in 


e"St[H(»)-H(t)]dt 


*  l  O  {f  tje‘St[F(»)-F(t)]dt}  (x(j=n)  *  ptn~VStdH(i 
j*0  J  Jo  Jo 


by  (2.3.5) .  Thus 


J  n 


-st 


|tVst[H(»)-H(t)]dt  1  ♦  [  e~stdH(t) 
Jn  Jn 


1-u, 


e  [F(<a)-F(t)  ]dt 


n-1  r<*> 

l  ("){ 

j»0  J  J0 


t^e"St[F(»)-F(t)  ]dt}  (f  tn'VStdH(t)> 

J  n 


(1-0,)  f  tVJt[F(»)-F(t)]dt 
J0 


-st , 


Therefore 


lim 

s-K) 


ft" 

lo _ 

ft" 

Jo 


•st 


e  [H(°o) -H(t)  ]dt 


e"St[F(»)-F(t)]dt 


(1-u,) 


2  • 


(2.3.7) 


Hence  if  is  the  first  infinite  moment  of  F  (n  =  0,  1,  ...): 
then  by  (2.3.7)  and  Theorem  2.1, 


f  e‘Sttn°[H(-)-H(t)]dt 
J0  1 


T  e‘sttn°[F(«)-F(t)]dt  (1"w) 
Jn 
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As  a  result. 


r  ' 


& 


_d_  JO 
ds 


r40  n 

e'stt  °[H(.)-H(t)]dt 

'0 _ 

n 

e'Stt  °[F(-)-F(t)]dt 

i  ft 


■*  0  as  >  s  +  0; 


i.e. , 


n„+l 


f  e‘stt  0  [H(»)-H(t)]dt 

Jn 


r 

•*0 


-st  no 

e  STt  °[F(-)-F(t)]dt 


f  e-sttn°[H(.)-H(t)]dt  r.-“tVlf«-)-F(t)Id. 
Jo  jft 


Jo 


{J  e‘stt  °[F(-)-F(t)]dt}  2 


Consider 


n«+l 


f  e~Stt  0  [H(-)-H(t)]dt 

Jft 


r°°  n_  +  i 

e~Stt  0  [F(-)-F(t)]dt 

Jft 


n„+l 


]  e"5tt  0  [H(-)-H(t)]dt  |  e'Stt"°[F(»)-F(t)]dt 

Jft  Jn 


r 

■'0 


e‘Stt  °[F(»)-F(t)]dt  P  e'Stt  0  [F(»)-F(t)]dt 

Jft 


-OO  J| 

e‘Stt  °[H(«)-H(t)]dt  j  e’stt  0  [F(»)-F(t) ]dt 

Jo  Jn 


i 


(I  e"stt  °[F(*)-F(t) ] dt }  2 


o(l)  }  x 
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r00  n 

e"Stt  °[F(«)-F(t)]dt 

£o _ . _ 

-  _st  nn+1 

r  •  «  [F(-)-F(t)]dt 


w 


r 

_£ 

jo 


n_ 

e”Stt  [H(«)-H(t)]du 
t  nn 

•  t  °[F(-)-F(t)]dt 


0 


[F(-) 


‘Sttn°  1[F(- 


Therefore 


lim 

s-+0 


f 


n  +1 

e"Stt  0  [H(«)-H(t)]dt 

~ -st  V1 

®  t  [F(«)-F(t)]dt 


Cl-ca)2  ’ 


By  induction. 


lim 

s-K) 


r 

£o 

r 

Jo 


e"Sttm[H(«)-H(t)]dt 


e‘Sttm[F(«)-F(t)]dt 


1 

(1-ui)2 


for  every  integer  m  >  n. 

And  now  Theorem  1  ensures  the  result. 


Lemma  2.7 


lim  Hfrl-H(x)  , 

FM-F(x) 


(1-w)2 


F(t) ]dt 


)-Fft)dt 


Since  both  the  numerator  and  the  denominator  diverge,  this  can  be 
true  only  if 


lim 

X-H» 


HM-H(x) 

FW-F(x) 


1 

(1-u))2 


In  the  next  chapter,  we  shall  see  that  if 


lim 

X-H*> 


HQ)-H(x) 

F(°0-F(x) 


1 

2  ’ 

(l-«) 


then  conditioning  on  {A(t)  =1}  has  no  ultimate  effect  on  the 
behavior  of  the  renewal  process.  Thus  this  last  lemma  tells  us  that 
if  F  has  an  infinite  moment  and  is  well  enough  behaved  to  ensure 


lim 

t-*» 


FH-F(t) 


exists,  then  it  is  hopeless  to  try  to  develop  a  theory  paralleling 
standard  renewal  theory  by  conditioning  on  (A(t)  *  1}. 


CHAPTER  3 


THE  SUB -EXPONENTIAL  CASE 


3.1  DEFINITIONS  AND  BACKGROUND 


We  need  to  know  when  lim  4-  *  - =r  and  the  ramifications 

F(“)-F(x)  .2 

X-wo  v  ( 1  -co) 


of  this  equality.  Some  preliminary  definitions  are  required. 

Let  G  be  a  proper  distribution  on  (0,°°)  such  that  G(0+)=0  and 
G(x)  <  1  for  0  <  x  <  ®.  G  belongs  to  S,  the  sub -exponential  class 
of  distributions,  if 


Urn  .  2 

11  l-G(x) 

X-” 


(3.1.1) 


The  class  S  was  introduced  by  Chistyakov  (1964);  he  found  it  useful 
in  studying  branching  processes. 


Lemma  A  (Chistyakov) 

If  G  e  S,  then  lim  =  1  for  all  s  <  ». 

_  l-G(x) 

X-H»  V  1 

Because  l-G(x)  is  a  function  of  moderate  growth, 

rx 


l-G(x)  ~  k  exp{-[  a(u)du) 
J0 


where  a(u)  2  0  and  a(u)  -►  0.  Hence 


; « 


r: 

i>n 


R 
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The  fact  that  the  tail  of  G  converges  to  0  more  slowly  than  any 
exponential  function  explains  the  label  "sub-exponential." 

Lemma  B  (Chistyakov) 

If  G  €  S,  then 

l-GW(x)  ,  ,,  ,  ,, 

lim  l-G(x)  '  k-  (3.1..) 


Athreya  and  Ney  (1972)  have  also  used  the  class  S  to  deal  with 
branching  processes  and  have  proved  the  following  useful  lemma. 


Lemma  C  (Athreya  and  Ney) 

If  G  €  S,  then  given  any  e  >0,  there  is  a  D  <  °°  such  that 


1-Gtn)00 

l-G(x) 


<  D(l*e)n 


for  all  n  and  x. 

Teugels  (1975)  used  these  lemmas  to  prove  an  important  theorem 
for  transient  renewal  processes. 


Theorem  A  (Teugels) 

If  F(«)  *  (ii  <  1,  the  following  statements  are  equivalent. 


(i)  F(“)"1F(x)  e  S 

(ii)  H(»)-1H(x)  €  S 


(iii) 


lim 

x-*°> 


H(a>) -H(x)  . 
F(°°)-F(x)  “  ' 


(1-w)2  ’ 
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Chistyakov's  result  on  the  expected  number  of  particles  at 
time  t  in  an  age-dependent  branching  process  is  now  an  easy  conse¬ 
quence  of  Theorem  A.  From  equation  (1.4.18)  we  have 


A(t) 


l-G(t) 


[1— G(t-T)]dHa(T) 


where  is  the  transient  renewal  function  corresponding  to  the 
defective  distribution  oG.  Evaluating  the  integral,  we  find 


A(t)  *  1  -  (ot'1-l)Ha(t) 


or 

A(t)  ! 

l-G(t)  ’  o-oG(t)  ■*  l-o 


(3.1.3) 


as  t  -*■  »  if  and  only  if  G  e  S. 

We  shall  see  that  when  u>~1F(x)  e  S,  the  resulting  transient 
renewal  process  has  remarkable  properties.  It  is  worth  noting, 

therefore,  that  distributions  of  this  type  can  be  quite  simple  in 

form.  For  example,  u)_1F(x)  «  S  if 

(i)  w-F(x)  ~  x~aL(x),  a  2  0  and  L  is  slowly  varying. 

(ii)  w-F(x)  ~  k  exp{-x8},  0  <  S  <  1. 

-  6 

(iii)  uj-F(x)  ~  k  exp  (x(logx)  },  S  >  1. 

However,  if  8  <  1  in  (iii),  a>**F(x)  i  S.  (See  Teugels  (1975).) 
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3.2  PROPERTIES  OF  TRANSIENT  RENEWAL  PROCESSES  WHEN  ui'^Cx)  €  S 
Conditioning  on  {A(t)  =1}  focuses  on  only  those  processes 
alive  at  time  t.  One  feels  intuitively  that  if  the  process  is  alive 
at  t,  it  should  be  behaving  like  an  ordinary  renewal  process.  In¬ 
tuition  is  far  from  correct,  however,  when  uj~*F(x)  is  a  sub-exponential 
distribution.  In  fact,  many  limit  results  are  the  same  regardless 
of  whether  one  conditions  on  (A(t)  *  1}. 

Lemma  3.1 

If  a)  *F(x)  €  S,  then 

lira  P(N(t)  -  k ) A ( t )  -  1}  -  lim  P{N(t)«k)  -  u»k(l-w). 
t-«  t— 

Proof : 

P(N(t)-k,  A(t)«l>  ■  ft[w-F(t-r) ]dF^k) (r)  • 

J0 

u.F(k)(t)  -  F(k*1}(t).  (3.2.1) 


P(N(t)  -  k  j  A(t)  «  1> 


uiF(k)(t)-F(k+1) 
(!-<*»)  [H(«)-H(t)] 


(t) 


Thus 


-  so  - 


-*•  { (k+l)uk  -  ka)k}(l-u)  =  U»k(l-U)),  (3.2.2) 

by  Lemma  B  and  Theorem  A.  But 

P{N(t)  *  k}  *  F(k)(t)  -  F(k+1)(t)  -  u)k(l-a))  (3.2.3) 

□ 

If  N(t)  is  the  renewal  count  for  a  proper  renewal  process,  then 
lim  P{N(t)  =  k}  =  0  for  all  fixed  k. 

t*H» 

Thus  this  simple  lemma  warns  us  that  even  those  transient  processes 
alive  at  time  t  do  not  behave  like  proper  processes.  The  fact  that 
N(t)  is  not  growing  large  as  t  increases  is  reflected  in  the  asymptotic 
properties  of  the  forward  and  backward  delays  and  in  X^t^,  the 
lifetime  spanning  time  t. 

Lemma  3.2 

P^XN(t)+l  >  t!A(t)  58  1}  1  as  t  -*■  ®. 

Proof : 


P{XNC«.l  *  '•  *(t)  *  U 


*  P{N(t)  •  0,  A(t)  -  1)  ♦  l  P(N(t).n,  Xn<l>t,  A(t)*l} 


=  u)-F(t) 


00 


*  l 

n»l 


ft 
■  0 


[aj-F(t)]dF(n)(T) 


[u-F(t) ] [1+H(t)]  . 


(3.2.4) 
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Hence 


lira  P<XN(t)+1  >  t | A(t)  *  1> 


lim  [ 


U)-F(t)  •]  rl+H(t)  1  _ 
H(»)-H(t)n  1-u  J  " 


(!-<■>) 
(l-a»)  2 


(3.2.5) 

□ 


Therefore,  if  the  process  is  alive  at  some  distant  time  t,  this 
seems  to  be  because  one  of  the  lifetimes  begun  prior  to  the  instant 
t  is  itself  longer  than  t.  Evidently  we  have  not  observed  a  large 
number  of  moderate  lifetimes;  processes  built  up  of  many  such 
"reasonable"  X's  would  have  died  before  reaching  time  t. 

Given  this  result  about  =  nt  +  ’t’  **  is  not  surPrisin8 

that  the  forward  and  backward  delays  have  degenerate  limiting  distri¬ 
butions.  From  (2.2.6), 


lim  P{CtSxjA(t)*l}  *  lim 
t-»»  t-*-* 


[l-F(tfx-x)]dH(T) 
(1-w)  [H(“>) -H(t)  ] 


s  lim 
t-w» 


H(t+x)-H(t) 

( 1  - co )  [H(“)  -H(t)  ] 


0  for  all  fixed  x. 


Similarly,  (2.1.1)  yields 

lim  P<V*|Alt).l)  .  lim  fcjnMSEh 


lim 

t-*» 


H(t) -H(t-x) 
H(«)-H(t) 


0  for  all  fixed  x. 


Before  studying  and  t\  more  closely,  we  prove  a  simple  lemma. 


Lemma  3.3 


Suppose  G  e  S.  Then  for  any  e  >  0  and  integer  k,  there  exists 
a  A(e,k)  such  that 


iim 

t-*» 


1-G(t-T)1 

l-G(t) 


d G(k)(r)  <  e  . 


(3.2.6) 


Proof : 


Choose  A(e,k)  such  that  G  (A)  >  1-e.  We  know 


(k) 


.00 


lim 

t-*» 


.(k+1) 


G  (t)-Gv  ^  ft) 

i-c(t)  "  * " j0  i-G(t) 


1  *  lim  P  dG(k)(t)  (3.2.7) 

t-WO  j  0  1-G(t) 


and 


^:i-G(t)J'  dcCk)(T)  2  G(k)(A)  >  1-e. 
Lemma  3.4 

Suppose  to  1F(x)  e  S.  Then 


□ 


lim  P(n  st-cjA(t)*l,  N(t)>l)  = 
t-*» 


H(”) -H(c) 
H(») 


Proof : 

P(nt  *  t-c,  A(t)=l}  »  [  [w-F(t-t) ]dH(r)  (3.2.8) 

'  c 

while 

P(A(t)-l,  N(t)il)  «  f  [u)-F(t-r)  JdH(t)  «  F(t)-(l-u>)H(t) . 

'0 


(3.2.9) 
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Note  that 


lim 

t-H» 


a)-  (l-u)H(t) 
F(t) - (l-w)H(t) 


fm-  (l-u)H(t)  -  [a)-F(t)  1  1 


=  {1  -  (1-ui)}"1  =  a.'1. 


(3.2.10) 


Thus 


p{ntst-c|A(t)=l,  N(t)>l} 

*  [u)-F(t-t)  ]dH(t)  a)  -  (l-w)H(t) 

‘  Jc  (l-«)[H(-)-H(t)]'  *  F(t)-(l-«)H(t)  * 


Choose  e  >  0.  Then  there  is  some  A(e)  >  c  such  that 


t 

•  A 


(i)-F(t-T) 

(l-oo)  [H(«)  -H(t)  ] 


dH(x)  <  e 


by  Lemma  3.3.  Hence 


Toi-FCt-c)  ]  [H(A)-H(c)  1  f*  [u»-F(t-x)]dH(t) 

(1-u) [H(»)-H(t) ]  Jc  (1-u) [H(-)-H(t)] 


S 


[u>-F  (t-A)  1  fH(A)  -H(c) ] 
(1-u) [H(») -H(t) ] 


e . 


(3.2.12) 


But 


, ._  u-F(t-s) 

\!Z  (l-u) [H(»)-H(t)] 


(l-o») 


for  all  fixed  s  and  e  is  arbitrarily  small  while  A  is  as  large  as 
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£  lim 


HQ) -H(t»\t) 
(1-u) [H(-) -H(t) 


L»J -Htt»At-yj< 
HO)  -H(t+At) 


5  0  by  Lemma  3.3. 


(3.2.16) 


To  study  the  moments  of  N(t),  we  begin  by  finding  expressions 
for  these  moments.  The  factorial  polynomial  is  defined  as 

x^nj  *  x(x-l) ‘“(x-n+l);  x^  =1  (n-0,  1,  2,  ...).  Stirling's 
numbers  of  the  second  kind  are  used  to  express  xn  as  a  linear 
combination  of  factorial  powers  of  x  no  higher  than  the  nth. 


x  =  t  .x...  +  t  ,xM.  +  •••  +  t  x,  . 
nl  (1)  n2  (2)  nn  (n) 


Lemma  3.6 

a)  E.N(t)kA(t)  »  l  j.'t  [UH(j)(t)-(l-a))H(:i  +  1)(t)]  and 

j=l  J 


b)  EN(t)k  *  l  j!t..HU)(t) 
j»l 


where  the  t^'s  are  Stirling's  numbers  of  the  second  kind. 


Proof: 


a)  EN(t)  A(t) 


<*>  ,  ft 

I  n  [«■ 
n*l  J0 


F(t-t) ]dF^n^ (t) 


«  j  nkOF(n)(t)-FCn+1)(t)J 
n*l 


(3.2.17) 


■>  L{EN(t) kA(t) }  *  [u»-F*  (s)  ]  £  nkF*(s)n. 


(5.2.18) 


so  we  can  write 


n  =  >  t,  .n,.., 

>1  kJ  or 

L{EN(t)kA(t)}  =  [u-F*(s) ]  l  t.  .  I  n  F*(s)n 

j  =  l  J  n=j  UJ 

*  [«-F*(s)]  l  t  F*(s)J  l  n  F*(s)n'j 

j-1  n=j  Uj 

k  .  . 

*  [o»-F* (s) ]  l  j!t..F*(s)J[l-F*(s)]J+1 

j*l  3 


*  I  j!tk.[w-F*(s)]H#(s)j[l-F*(s)]'1.  (3.2.19) 

j»l 


it  if  if 

From  the  equation  H  (s)  =  F  (s) [1*H  (s)],  we  see  that 
(1-F*(s)) (1+H*(s))  =  1.  Hence 


[w-F*(s)] [1-F*(s)]_1  -  «  -  (l-w)H* (s) .  (3.2.20) 


Substituting  the  expression  in  (3.2.20)  into  (3.2.19),  we  find 


L{EN(t)kA(t) }  *  l  j't .k(aH*(s)j-(l-«)H*(s)j+1} 

j*l  3 


and  hence 


EN(t)kA(t)  =  l  j  !tu..  (mhO^  (t)  - (l-u)H^+1^  (t)  }  .  (5.2.21) 
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b)  EN(t) 


i  »kf 

n=l  J0 


[l-F(t-t)]dF(n) (t) 


-  l  nk[F(T°  (t)-F(n+1)(t)] 

n=l 


(3.2.22) 


Therefore 


l.{EN(t)k)  =  [1-F*(s) ]  l  nkF*(s)n 

n=l 


■  l  j!t,  .H*(s)j  from  (3.2.19) 


Hence 


EN(t)k  -  I  j!t,.H(jJ(t) 
j-1  J 


(3.2.23) 


Theorem  3.1 


lim  E(N(t)  |A(t)  =  1]  =  lim  EN(t) 

t-X”  t-*-0 


J,  if  and 


only  if  ui“  F(x)  e  S, 


Proof: 


(i)  Suppose  u)_1F(x)  e  S.  Then  H(»)_1H(x)  e  S  and  by  Lemma  B, 


tj—]  -H(n3(t) 
H(»)-H(t) 


n(^ 


n=l,  2, 


(3.2.24) 


H(n^  (t) 


H(-) -H(t) 


(3.2.25) 


;i-u))H(n)  i  t) 


n  n-1 

_  nu ,, , 

n  'in-1  rti  "  n  ^n-1  +  °  1 
(1-w)  q(t)  ( 1  -u>) 


0) 

Multiplying  by  y^j-  ,  we  have 


aiH(n)(t)  _ 

q(t) 


n+1 


u 


(l-u>)  q(t) 


n 

nw 


(l-u>)n 


♦  0(1)  . 


(3.2.26) 


Taking  n  =  k  in  (3.2.26)  and  n  =  k+1  in  (3.2.25)  and  subtracting,  we 
find 


uHCk)  (tj-d-MjH^1^  (t)  _ 

q(t) 


k 

0) 


(l-cj)k 


+  0(1). 


(5.2.27) 


Therefore 


lim  E[N(t)k|A(t)=l] 
t-*» 


k 

lim  l 
t-*»  j=l 


ra>H(j)(t)-(l-h))HCj'l'1)(t)1 
J,tkjl  q(t)  J 


-  I 

j=l 


lim  l  j!t..H0)(t) 
t<"»  j=l 


=  lim  EN(t)k  by  (3.2.21)  and  (3.2.23). 

t-**> 


(ii)  Now  suppose 

k  k  j 

lim  E[N(t)K|A(t)=l]  *  l  jltk .(y^y)  . 

t-*»  j=l 

Taking  k  *  1,  we  have 


fZ  [H  (*)  -H(t-t) jdH  (t)  „  _w_ 
H(-)-H(t)  1-w 


0 


by  (2.1.2). 
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That  is, 

H(»)2-H(2^  (t)  H(°°)  2-H{°°)H(t)  oj 

H(«)-H(t)  H(»)-H(tJ  "  1-u  ‘ 

But  then 

H(»)2-H(2;i  (t)  .  2co 
H(»)-H(t)  l-u>  ’ 

which  is  equivalent  to  saying  H(“)  ^H(t)  e  S.  Theorem  A  implies 
co  1F(t)  e  S  as  well.  □ 

Smith  (1959)  has  shown  that  when  {X.}  is  a  proper  renewal  pro- 
cess  E[N(t)  ]  is  asymptotically  a  kth  degree  polynomial  in  t. 

However,  when  {X^}  is  transient  and  co  *F(x)  e  S,  the  moments  of 
N(t)  converge  to  finite  values,  even  when  we  restrict  our  attention 
to  moments  of  processes  alive  at  t.  This  is  an  important  discrepancy. 
For  example,  many  of  the  standard  renewal  theoretic  results  cited  in 
Chapter  1  are  direct  outgrowths  of  the  Key  Renewal  Theorem,  which 
depends  in  turn  on  the  approximate  linearity  of  H(t)  =  EN(t) .  Our 
efforts  to  recover  these  standard  results  in  the  transient  setting 
by  conditioning  on  (A(t)  -  1}  are  completely  fruitless  when 
u)-1F(x)  e  S  because  E [N(t)  |  A(t)=l]  -*■  . 

In  the  sub-exponential  case,  conditioning  on  (A(t)  =1}  seems 
to  have  little  effect  on  the  long  term  properties  of  the  transient 
process.'  We  have  seen,  for  example,  that 

lim(P{N(t)=k| A(t) =1}  -  P{N(t)=k})  =  0 

t-H» 


lim(E [N (t) k | A(t) =1]  -  E[N(t)k])  =  0. 
t-x» 

This  is  particularly  surprising  in  light  of  later  chapters,  where 
we  shall  see  that  when  the  tail  of  F  decreases  exponentially,  the 
conditioning  scheme  is  very  effective  in  developing  a  theory  paral¬ 
leling  the  standard  renewal  theory. 


CHAPTER  4 
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When  a)  holds, 


lim  f°  eCt[F(»)-F(t)]dt  = 
cto  J0 


(1-0))  +oJt 


eot[F(«)-F(t)3dt 


(4.1.2) 


by  the  Monotone  Convergence  Theorem. 

However,  if  the  integral  diverges  and  b)  obtains,  then 


lim  j  eCt[F(»)-F(t)]dt  = 
cta  •'0  0 


eot[F(»)-F(t)]dt. 


(4.1.3) 


Of  course 


f  ect[F(»)-F(t)]dt  =  LklL* 
Jn  a 


and  hence  either 


a)  F  (-cr)  * 


+  U)<1 


l+[o(l-w)£]' 


b)  F  (-o)  =  1. 


Lemma  4.1 


If  q(t)  ~  ke"0t,  then  F  (-0)  »  1. 

Proof : 

If  q(t)  =  (l-a»)  [H (°°)  -H(t) ]  ~  ke‘0t, 

lim  I  ect[H(«) -H(t) ]dt  =  ® 
cto  ■'O 

and  the  result  follows  from  the  previous  discussion.  □ 

* 

Suppose  that  F  (-0)  =  1.  Then  we  can  define  the  proper  distri¬ 
bution  F  by 

dF (x)  =  e°xdF(x) .  (4.1.3) 

Write  E  and  P  for  expectations  and  probabilities  with  respect  to 

-  -  k 

this  distribution;  let  »  EX  s  ®. 

We  say  that  a  stochastic  process  G(t)  is  natural  if  its  distri¬ 
bution  depends  only  on  t  and  X^,  X9,  ...,  Cumulative  pro¬ 

cesses  are  therefore  natural.  G(t)  is  a  proper  process  defined  for 
all  t  if  X1  ~  F;  it  is  transient  if  X^  ~  F.  The  proper  and  transient 
processes  are  said  to  be  equivalent  and  their  expected  values  are 
related. 


-cS 


Ee 


N(t)+1 


G(t) 


-  I 

n=0 


(N(t)=n) 


G(t,x 


1’ 


(x  ,) 
n+1' 
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*  l  f  G(t,x.,  —  ,x  .JdFtx.)  ,,*dF(x  ,) . 

n=0J{N(t)=n}  1  n+1  1  n+1 

(4.1.4) 

In  the  right  hand  side  of  (4.1.4),  G(t)  is  a  transient  process. 
However,  the  expression  is  well-defined  because  on  each  set 
{N(t)*n},  • *+Xn^t«»  and  Xn+^<®  since  we  are  integrating  with 

respect  to  dF(xn+p.  Thus  the  process  G  is  alive  at  time  t. 

Remembering  that  *  t+ct»  we  can  rewrite  (4.1.4)  as 

t  -o? 

e  Ee  cG(t)  *  EG(t)A(t) .  (4.1.5) 


Lemma  4.2 


If  F  (-o)  *  1  and  =  |°°  xe0XdF(x)  <  ®,  then  q(t) 


~  d-o»)_e 


-ot 


0U, 


Proof : 


Let  G(t)  =  1  in  (4.1.5).  Then 


-otg  ~°^t  .  . 

e  Ee  *  q(t) . 


(4.1.6) 


From  (1.1.13), 

-  'aS 

lim  Ee 
t-*» 


=  r(o) 

CTMj  k  J 


□ 


* 

We  shall  assume  thatF  (-o)ml  throughout  the  remainder  of  this 
chapter  and  in  the  next  two  chapters.  Equations  (4.1.5)  and  (4.1.6) 
yield 


E[G(t)|A(t)-l] 


-  '05t 
Ee  fcG(t) 


Ee 


(4.1.7) 


Suppose  G(t)  is  a  cumulative  process.  Then  the  right  hand  side 
of  (4.1.7)  involves  G(t),  a  proper  process  built  up  from  N(t)  inde¬ 
pendent  random  variables  and  some  extra  piece  unlikely  to  affect  the 
distribution  of  G(t)  substantively  for  large  t,  and  the  time  from 
t  until  the  next  event.  In  a  loose  sense,  c  is  determined  by  local 
X's  around  time  t  while  G(t)  depends  on  all  tours  up  to  time  t.  We 
are  led  to  consider  the  circumstances  when 

-  -oi:t 

EC  g£  ^  ‘  +  0  as  1  +  "  (4.1.8) 

Ee  X 

for  when  (4.1.8)  holds,  we  have 

E[G(t)  | A(t)*l]  -  EG(t)  -*■  0  as  t  ♦  »  (4.1.9) 

and  we  can  apply  our  considerable  knowledge  about  EG(t)  to  the 
transient  process. 

4.2  THE  ASYMPTOTIC  INDEPENDENCE  OF  g  AND  G(t) 

The  notions  of  sluggish  events  and  processes  are  helpful  in 
finding  conditions  guaranteeing  that  (4.1.9)  holds.  An  event  A(t) 
is  sluggish  if  P(x(A(t))  +  x(A(t+T))}  +  0  as  t  »  for  all  fixed 
T  >  0.  A(t)  is  natural  if  x(A(t))  is  a  natural  process.  The 
following  unpublished  theorem  is  a  major  step  toward  the  desired 
conditions  assuring  the  asymptotic  independence  of  G(t)  and  . 

Theorem  B  (Smith) 


Suppose  A(t)  is  a  sluggish  and  natural  event.  Then  if 


(4.2.1) 


S[K(x)+e]P{A(t)}  +  PUt>T) 
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*  [K(x)+£]P{A(t)}  ♦  l-K(T)*e. 

But  for  sufficiently  large  T,  l-k(T)  <  e  and  thus 

P{;t+2TSx,A(t)}  S  k(x)P{A(t)}  ♦  3e .  (4.2.4) 

(4.2.3)  also  yields 

P(5t+2TSx,A(t)}  S  (k(x)-e]GA  (T)  =  [k(x) -e] [P{A(t)  -P(A(t) , ?t>T} ] 
2  K(x)P{A(t)}  -  P{A(t),;t>T}-e 
>  K(x) P{A(t) }  -  [l-K(T)+e]-e 

2  R(x)P{A(t) }-3e .  (4.2.5) 

Therefore 

llmPt?  ^^(^J-kt^PCA^)}  <3e(T)  (4.2.6) 

t-M» 

where  e(T)-K)  as  T-**>.  Because  A(t)  is  sluggish, 

P(;t+2T^x,A(t)}-P{i;t+2T5x,A(t+2T}  -►  0 

and 


P{A(t)}  -  P{A(t+2T) }  0. 
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Therefore 


lim 

t-»« 


P{5t+2i^x»ACt+2T)  )-K(x)P{A(t+2T)  } 


=  lim 

t-M> 


P{?t+2TSx,A(t) }-~(x)P{A(t) } 


<  3e(T) 


That  is. 


P(CtSx,A(t)}-K(x)P{A(t)}  ^Oast 


Corollary  4.1 


If  A(t)  is  a  sluggish  and  natural  event  and  y  <  then 


— - -  P{A(t) }  0. 

u z 


(4.2.7) 


Proof : 


"a?t 

Choose  e>0.  There  exists  an  N  such  that  if  ct>N,  e  <e. 


Let  B^  »  (?t<N}1 


*o? 


-0? 


Ee  tX(A(t))-Ee  ^(ACtjnB^  ♦  Ee  ^(ACtJnB^)  (4.2.8) 


-  "a?t  c 

Ee  x(A(t)nBNc)  <  e. 


(4.2.9) 


Establish  a  partition  0  *  xQ<x^<* • *<xn*N  with  mesh  m. 
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By  Theorem  B 


B 


-or  n-1  -ax.  . 

lim  {Ee  x(A(t)nB  )-  J  e  3*AP{A(t) } [K(x  )-K(x  ) ] }  >  0 
t-*oo  1  j=0  3  ^ 


(4.2.10) 


■05, 


lim  l  e  3P(A(t)}[K(x.  )-K(x.)]-Ee  ^CAftJnBj}  *  0. 

t-~  j=0  3  1  3  N 

(4.2.11) 


Letting  m  -*■  0,  we  conclude 


-at  rN 

lim  (Ee  x(A(t)nB  )-P(A(t)}  e'°XdK(x) }  =  0. 

t-~>  3  0 


(4.2.12) 


(4.2.8),  (4.2.9),  (4.2.12),  and  the  arbitrary  size  of  e  imply 


-at 


Ee  tx(A(t))  -  P(A(t) }K*(cr)  -  0. 


The  conclusion  follows  because  when  <  ®,  Ee  t  -*■  K*(a). 
application  of  this  corollary  produces  the  following  lemma. 


Lemma  4 . 3 


A  direct 


★  ^  * 


Let  W(t)  be  a  cumulative  process  such  that  EY^  =  ®  and 


y^  <  «*.  Then 


P{ 


W(t) 

t 


>  e 


A(t)  »  1)  +  0  as  t  +  •. 


(4.2.13) 


Proof : 


Let  A(t)  «  { 


W(t) 

1  D1 


>  c } . 


A(t)  is  sluggish  because  P(x(A(t))  t  x(A(t+T))}  s  P(A(t)}  + 
P{A(t+T}  +  0  as  t  +  ■  since  a.s.,(P)  when  £L  <  •  and 

w  U  -  1 

★  1 


A(t) =1 } 


£e  txCA(t)) 


Ee 


-act 


(4.2.14) 


*  P(A(t) )  +  o(l)  by  Corollary  4.1.  □ 

To  translate  the  asymptotic  independence  of  c  and  A(t)  into 
an  independence  result  for  5  and  some  process  G(t),  we  define 
sluggish  processes.  A  real  valued  process  G(t)  is  sluggish  if  for 
all  x  outside  a  set  E  of  Lebesgue  measure  0  and  for  all  fixed  T  >  0 

P(G(t)<x<G(t+T}  +  P{G(t)>x>G(t+T)}  +  0. 


Lemma  4.4 

If  G(t)  has  a  limiting  proper  distribution,  then  G(t)  is  sluggish 

5 

if  and  only  if  G(t+T)-  G(t)  +  0  as  t  + 

Proof : 

(i)  Suppose  G(t)  is  sluggish  and  has  limiting  distribution  J. 

Fix  e  >  0.  There  exists  some  N(e)  such  that  ±N  are  continuity  points 
of  J  and  J (N)  -  J(-N)  >  1-e.  Let  A^  =  (-N,N] . 

P{  |G(t+T)-G(t)  |  >e}  <  P{  |G(t+T-G(t)  j  >e,  Gtt+TH^, 


G(t)«AN>  ♦  PCGCt+T^Aj,6}  +  P(G(t)6.ANC}. 


(4.2.15) 


Let  -N  =  Xq<x1<***<x^  =  N  be  a  partition  of  such  that  x^-x^  < 

and  x.eEc 
3 

P{  | G(t+T-G(t)  | >e,  GCt+T)^,  G(t) eA^} 

M-l 

s  l  P{G(t+T)e(x  ,x  ],  G(t)  i  (x  ,x  ]} 
j=0  J  J  3  3 

M-l  M-l 

<  l  P{G(t)Sx.<G(t+T) )  +  l  P{G(t+T)<x.<G(t) } 
j=0  3  j=0  3 

+  0  as  t  +  ”  since  G  is  sluggish.  (4.2.16) 

Tim  [P{G(t+T)eA  c} * P{G(t)eAMC}]  <  2e.  (4.2.17) 

e  is  arbitrary;  thus  (4.2.15),  (4.2.16),  and  (4.2.17)  imply 
G(t+T)  -  G(t)  £  0. 

(ii)  Now  suppose  G(t)  has  limiting  distribution  J  and  G(t+T)  - 

p 

G(t)  -*■  0.  Define  E  =  (x:  J(x)  ^  J(x-)};  E  has  Lebesgue  measure  0. 

c 

Let  xeE  and  choose  e>0. 

P{G(t) Sx<G(t+T) }  *  P{G(t)sx}  -  P{G(t)Sx,  G(t+T)<x) 

£  P(G(t)Sx)  -  P{G(t)£x-e,  | G(t+T) -G(t) | <e} 

=  P{G(t)sx)  -  P(G(t)£x-e}  +  P{G(t)£x-e, | G(t+T) -G(t) |>e) 


£  P(G(t)£x)  -  P{G(t)£x-e)  +  P{ |G(t+T)-G(t) j>e) 


(4.2.18) 


tj|m 
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-*•  J(xj  -  J(x-e)  by  assumption. 

But  x  is  a  continuity  point  of  J  and  e  is  arbitrary.  Thus 
P{G(t) sx<G(t*T) }  +  0  as  t  +  »;  the  argument  for  P{G(t) >x£G(t+T) } 
is  exactly  the  same.  □ 

Lemma  4 . 5 

Suppose  G(t)  is  a  sluggish  and  natural  process  such  that  for 
every  e  >  0  there  is  a  A(e)  making 

EG(t)X(|G(t) |  2  A)  <  e 


Now  establish  a  partition  -A  =  xq<xi<’ '  ,<xjsl  =  ^  having  mesh  m. 


-ac  N-l  -at 

Ee  tGCt)xCG(t)eB  )  =  l  Ee  lG(t) X Cxn<G(t) <xn+1) 

n=0 


and  hence 
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-  -°«t  -  -°5t 

N-l  xnEe  cX(xn<GCt)atn+1)  Ee  cG(t)x(G(t)€BA) 

n=0  7^1 

Ee 


-  -°Ct 
Ee 


-  _a^t 

N-l  x  ,£e  x(x  <G(t)Sx  ,) 
s  £  n+1  n  *■  1  n+1' 


n=0 


-05. 


(4.2.21) 


Ee 


Because  the  events  A  =  v(*  <G(t)Sx  , )  are  sluggish.  Corollary  4.1 

n  n  n+1 

implies 


-  ’0?t 

Ee  lG(t)X(G(t)eB  )  N-l 

—  [ - —  -  y  x  P { x  <G(t)<x  .}]  >  0 

*"*"  1  ~r  n  n  v  '  n+1  J 


-05. 


Ee 


n=0 


and 


-  "0Ct 

N-l  ,  Ee  *’G(t)X(G(t)eB  ) 

[  {  Xn+lP{xn<GCt)'Xn+l}- - - 3  -  ° 

t-K»  n=0  -  t 

Ee 


(4.2.22) 


Letting  the  mesh  m  approach  0,  we  find 
-  -°;t 

Ee  tG(t);<(G(t)€BA)  . 

lim  [ - — - —  -  EG (t)  x (G(t) eB  )  ]  =  0.  (4.2.23) 

_  -0+,.  * 


(4.2.20)  and  (4.2.23)  guarantee  the  result.  □ 

The  following  lemma  is  useful  for  checking  that  the  conditions 


of  Lemma  4.5  are  fulfilled. 
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Lemma  4.6 


Let  G(t)  be  a  natural  process  having  proper  distribution  J. 


If  J  *  J  and 


|x|dJ  (x)  -*•  1  x  1  d J (x) 


(4.2.24) 


then  for  every  e  >  0  there  is  a  A(s)  making  |x|dJ  (x)  <  e 

J { | x| >A>  t 

for  all  sufficiently  large  t. 


Proof: 


Fix  e  >  0.  There  is  a  such  that 


xjdJ  (x)  -  |x|dJ(x)  <  c  for  t  a  T 


(4.2.25) 


by  (4.2.24)  . 


There  is  a  A 


* 

(e)  such  that  |x|dJ(x)<e,  (4.2.26) 

{ I x i >A) 


where  ±A  are  continuity  points  of  J.  Define  g(x)  *  |x|,  |x|  £  A, 

A  otherwise,  g  is  a  bounded  continuous  function  and  thus 


Jg(x)dJt(x)  g(x)dJ (x) 


Thus  for  t  a  T->, 


f  r 

g(x)dJt(x)  -  Jg(x)dJ(x)  <  e . 


(4.2.27) 


Because  ±A  are  fixed  continuity  points  of  J, 


1-J  (A)  +  J*(-A)  ->  l-J(A)  +  J(-A). 


In  particular,  for  t  2  T,, 


A 

Let  T4 


[l-Jt(A)+Jt(-A)]  - 
=  max(T1>  T2>  T,) . 


[1-J (A)  +J (-A)  ] 
Then 


<  e. 


(4. 2. 28) 


• 

r, 

r 

g(x)dJt(x)- 

g(x)dJ(x) 

+ 

| x|dJt(x)  - 

|x|dJ(x) 

for  t  >  T4  by  (4.2.27)  and  (4.2.25). 


=> 


{lx  >A> 


[|x|-A3dJt(x)  - 


{ [x] >A} 


[ 1 x 1 -A]dJ (x)  <2e 


(4.2.2S) 


=  > 


[  |  x|  -A]  dJ  (x)  <  3e 
Ji|x|>A}  r 


(4.2.50) 


for  t  >  T4  by  (4.2.26)  and  (4.2.30). 
(4.2.28)  and  (4.2.26)  and  hence 


But  A 


f 


dJ 


{ I x I >A> 


t(x)  <  2e  by 


[  |xjdJ  (x)  <  5e  for  all  t  >  T..  □ 

J { | x| >A>  Z  4 

4.3  RESULTS  AND  EXAMPLES 

We  now  use  the  technical  lemmas  of  the  last  section  to  derive 
some  results  about  transient  cumulative  processes.  We  also  return 
to  the  "time  until  ruin"  problem  discussed  in  Chapter  1. 

Lemma  4.7 

Suppose  W(t)  is  a  cumulative  process  such  that  fl  <  ®  and 


nx(t)  = 


i'V® i" 


is  a  sluggish  process, 


Proof : 


From  (1.2.4),  we  know  that  P(n^(t)Sa}  -*■  4(ct)  and  hence  by 

P 

Lemma  4.4  it  is  sufficient  to  prove  that  n^(t+T)  -  r^(t)  ->-0. 


1]  W(t+T) -<.N(t+T)  W(t)-<  N(t) 

- i - - i - 

5JJ 

yM  yMu1 


pj  W(t*T)-W(t)  lgitN(t-*-T)-N(t)] 

oJ^-  ’  aJHI 
1  yM  ^  yM  ^ 


w(t)-<  N(t)  rr—  I 

— 7=^(i-V^  >e! 


'V»T 


Hence 


P(|n1(t+T)-n1Ct)i>  e  } 


W(t+T)-W(S  f  )+W(SN.f  TJ-W(S  ,  J+W(s  ftl  +  i)- 


t+T 
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+  p 

[N(t+T)-N(t) ] 

>£ 

! 

W(t)-^N(t) 

„  zi/t+T 

9  JW 
y  1  Pj 

3 

1 

9  JX 

y  1*2 

3(/t^T-/t) 

=  A  +  B  ♦  C. 


(4.3.3) 


In  his  paper  introducing  the  concept  of  cumulative  processes. 
Smith  (1955)  proved  that  if  C  <  «  and  <  ®, 


ci)  w(t)-W(sNm> 


■*  0  a.s.  (P)  and 


W(SNftl+l)-W(t) 

(ii)  - SLLLLli: -  -*■  0  a.s.  (P). 

/t 


These  two  results  coupled  with  the  fact  that 


W(SN(tfT)'W(SN(t)-*-i:) 

/c+T 


N(t+T) 
l  Y. 

jsN(t)+2  3  .  N(t+T)-N(t)-1 

N(t+T) -N(t) -1  /t+T 


f  ,s.  (P)  by  the  Strong  Law  of  Large  Numbers  ensure  that  A  -*■  0. 

B  -*•  0  by  the  Strong  Law  also.  Finally,  C  -*■  0  by  the  asymptotic 
normality  of  n^ft).  n 

Lemma  4.8 

Suppose  W(t)  is  a  cumulative  process  such  that  O2  <  “  and 

★ 

<2  <  “  •  Then 
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n2(t) 


*  Pi 


is  sluggish. 


(4.3.4) 


Proof : 


(1.2.5)  and  obvious  modifications  to  the  argument  in  Lemma  4.7 


will  suffice. 


Theorem  4 . 1 


Let  W(t)  be  a  cumulative  process  such  that  u ^  <  00  and  ic*  <  °°. 


(W(t)-K!  N(t) 

(i)  p  - i -  <  a  |  A(t)=l  -  4(a) 

(a  *0” 

y  u, 


(4.3.5) 


(ii)  If,  addition,  <  «, 


"  p. 


*  *1 

—  S  a|A(t) 


(4.3.6) 


Proof: 


Using  the  notation  rij(t)  established  in  Lemmas  4.7  and  4.8, 
(rij(t)  s  a}  is  a  sluggish  event  if  condition  j  holds;  j  *  1,  2. 
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P(n j (t)Sa|A(t)=l}  = 


Ee  x(n.(t)Sa) 


$(a)  by  Corollary  4.1. 


Let  us  re-examine  the  "time  until  ruin"  problem.  We  found  that 


*  .  MIt) 


IIO 

P{t  St}  -  P{  l  L  >  u} 
k=l  K 

where  M(t)  is  the  renewal  count  for  the  transient  renewal  process 

* 

{Z  }.  Note  that  =  L^.  Let  J(z,2.)  be  the  joint  distribution 
of  Zj  and  L^^  and  suppose  there  is  a  a  making 


■In  Jn 


eCTZdJ(z,Z)  *  1. 


-  oz  -  ">  ~  2 

Define  dJ(z,£)  *  e  dJ(z,2,}.  If  EZ^“  <  »  and  EL^  <  ®,  then  Theorem 

4.1  implies 


M£t)  EL  t  EL.t 

( .  \  Lk  ■  Tzr  u " 

|  fell - - 1  >  - _ -1  | A(t) 

'  fn 

VlzT  >Ez7 


ELjt 

- u 


80 


CL>1  2 

where  y  =  £  (L^  -  .  Therefore 


P{x*st)  ~  (1~ul)-e 
aEZ, 


(4.3.7) 


where 


1-0)  =  P{Zj  soo). 


Equation  (4.3.7)  agrees  with  Cramer's  estimate  for  the  time  until 


ruin  (1955) . 


Theorem  4.2 


Suppose  W(t)  is  a  cumulative  process  such  that  <  00  and 


<2  <  «.  Then 


H.t  2 

E[(W(t)  -  -i-)  | A(t)  =  1]  =  ♦  o(t) 


Proof : 


(4.3.8) 


vr 

’ui 


,  as  before. 


P(n2(t)  So}  -  2 4 ( /x) - 1 ,  a  SO  since 


P(n2(t)  s a)  -*■  $(a) . 


-  81 


Smith  (1955)  has  shown  that  En2(t)  1  which  is,  of  course, 

2 

the  first  moment  of  the  limiting  distribution  of  n2(t)  •  Note  that 

2 

as  n2(t)  is  a  sluggish  process,  n2(t)  is  too.  Therefore,  by 
Lemma  4.5  and  4.6, 


~  ~°^t  2 

Ee  n2(tr  _  2 

- — - En2(t)  +  0  as  t  -►  ». 


(4.3.9) 


Hence 


E[ru(tr|A(t)  = 


*t  2 

n2(t)^ 


In  light  of  this  result,  it  is  reasonable  to  ask  whether 


Var[W(t)|A(t)  =  1]  =  f1  ♦  o(t) . 

1 


(4.3.10) 


We  have 


K.t  2 

E[(W(t)-E(W(t)  |  A ( t )  =  1 )  ♦  E (W(t)  |  A(t)  =  1)  -  p— •)  |  A (t )  =1  ] 


«  E[{W(t)-E(W(t)  | A ( t)  =!)}“*  | A ( t ) =1  ] 


ic.t  2 

+  (E(W(t)  |A(t)-l)  -  «^+o(t). 


If  we  can  show  that 


(E(W(t)  | A ( t )  =1 )  -  =  o(/t). 


then  we  will  know 


Var[W(t)|A(t)-l]  =  S.  +  0(t). 


CHAPTER  5 


THE  CUMULANTS  OF  TRANSIENT  RENEWAL  PROCESSES 

5.1  PRELIMINARY  RESULTS 

We  shall  show  that  when  the  proper  distribution  F  exists,  the 
kth  conditional  cumulant  of  N(t)  is  asymptotically  linear  in  t,  just 
as  is  the  kth  cumulant  of  the  renewal  count  of  a  proper  process.  To 
deal  with  cumulants,  Smith  (1959)  had  to  assume  that  (the  then 
proper)  F  e  C,  the  class  of  distributions  for  which  F^  has  an 
absolutely  continuous  component  for  some  finite  n.  We  will  need 
F  e  C  and  will  see  that  it  is  sufficient  that  F(°°)_1F  e  C. 

Lemma  5 . 1 

Suppose  dF(x)  =  eaXdF(x).  Then 


F(n)(x)  = 


ay  (n) ,  , 
e  *  dF  (v) . 


Proof : 


n 


F  fs)  =  F  (s-a)  =>  F  (s)  =  F  (s-c) 


That  is, 


-sxJ?(n).  . 
e  dF  (x)  = 


-sx  ax,_(n).  . 
e  e  dV  (x) 


(5.1.1) 


(5.1.2) 


E='°''  •  f  .-f«)dF(,) 


ft 


e-^Cy*T-t)df(y)dfi(T) 


t-T 


=  e 


at 


dF(t)  +  e 


at 


r  tr 

>Jt-T 


dF(y)dH(t) 


=  eot  [tu-  (l-ui)H(t)  ] 


(5.1.4) 


EN(t)k  =  l  nk[F(n)(t)-F(n+1) (t)] 
n=l 


(5.1.5) 


Hence 


*  _cCt  -  k 
Ee  *  EN(t)  = 


f  eo(t“T)(ui-(l-w)H(t-T)]  \  nk[dF(l°  (t)-dFU+1)  (x)  ] 


n=l 


at  r  k 
*  e  l  n 

n=l 


ft 


[u,-(l-W)H(t-T)ndF(n)  (T)-dFCn+1)  (T)] 


=  eot  l  nk[a)F(n)  (t)-wF(n+i:i  (t)-(l-u)F(n+1)  (t)] 
n=l 


xeotI  nk[uF(n)(t)-F(,’*1)(t)] 
n=l 


(5.1.6) 

□ 


Define 


tyt)  =  EN(t) 


00 


=  EN(t) [N(t)-1] • • • [N(t)-k+l] 


(5.1.7) 
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Lemma  5.4 


tyt)  =  k!H(k)(t). 


Proof : 


V*5  -  I  f  dF(y)dF(j)(r) 

j=k  ('1CJ  0  t- t 


(5.1.8) 


^°ts)  *  I  l 


t  /*CX> 

'st  dF(y)dF  ^  (t)dt 

j0  Jt-T 


l  !  I  e'St  dtdF(y)dF(j)(T). 

j=k  lKJ  0  J0  't 


oo 

=  s  ^  j(k)  fe‘ST^  (l-e'sy)dF(y)HF(-1- 

s  j=k  Jo  jo 


Cl-F*(s))  l  j  ,  .  F*(s)  ^  .-ilfJsli. 

j=k  UJ  s  [1-F  (s)  ]k 


- 1  ~*  k 

=  s  k!H  (s)  . 


(5.1.9) 


Since  M^.(t)  is  nondecreasing,  its  Laplace-Stielt jes  Transform  exists 


and  is 


>^*(3)  =  sMk°(s)  =  k!H*(s)k. 


(5.1.10) 


The  uniqueness  theorem  for  Laplace  Transforms  implies  the  result. 


Combining  Lemmas  5.3  and  5.4,  we  discover 

ft  s~a'’t-T,Q(k)r 

E[N(t)  J.A(t)  =  l]  *  k!  ^ ^ - LZI 

(k)  Jo  -  _a!;t 


(5.1.11) 
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-  (]c'j 

We  know  about  the  properties  of  H  from  Smith  (1959),  but  we  need 

,  -°St 

to  find  the  rate  at  which  Ee  converges  to  k  (c).  The  next 
lemma  provides  valuable  information  on  this  point. 

Lemma  5 . 5 

Suppose  m  2  1,  jj  .  <  and  F  e  C.  Then 
m+1 

~  ”CT^t  -m 

Ee  -K  (a)  =  oft  )  . 


Proof : 


r  e_a(x't5dF(x)  + 


rt  r® 


e‘C'!'X+T‘t)dF(x)dH(T) 


0;t-T 


..  -m-1. 

*  o(t  )  + 


r  t 


e"a(x+T't)dH(T)dF(x)  + 


t-x 


rco 


I 

Jt 


•a (x+T-t) 


J0 


dH(x)dF(x)  . 


(5.1.12) 


Note  that 
r°°  rt 


f  e-°(x*t-t)dH(T)dF(x) 

t  Jo 


-a(x-t) 


[t] 


e  -  l  e'aj[H(i+l)-H(j)]dF(x) 

t  j  =0 


<  <(l-e’CT)  *  r°  e"°^X  t^dF(x)  =  o(t 

‘  t 


-m-  1 . 


<  is  a  finite  upper  bound  on  H( j+1) -Hfi ) ;  thi< 


well-known  inequality. 
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3 


Hence 


ge  OCt  -  P  P  e_aUH(du+t-x) dF (x)  ♦  o(t“m_1) 
J0  -*0 


9 


.*  i 

K  (O  . 


e-o(y-x)df(y)dx 


9 


t  ry 


i'aiy'x)dx  dF(y)  +  ^  f  f 

U1  Jf  j0 


-o(y-x) 


if  f 

P1  J 0  J 


e”oudu  dF(y)  +  o(t  m  *) 

0 


Therefore 


-az. 


|Ee  "t-K*(o)|* 


k 


1  ^  e'ou[H(du+.t-x)  -  T~]dF(x) 
0  1 0  Vl 


/ .  -m-  X  -v 
♦  o(t  ) 


s  f  V  e'0^ |H(t+j+l-x)-H(t+j-x)  -  jr-  |dF(x)  + 
JO  j-0  1 


ft/2  [x)  .  .  I  .  , 

l  e"aj  |H(t+j+l-x)-H(t+j-x)  -  ~-|  dF(x) 
0  j=0  1 


1  f 

J  t/2 


+  KdW1  dF(x)  +  o(t”m"*) . 


(5.1.14) 


dx  dF(y) 


(5.1.15) 


,  -m-l* 
o(t  ) 


(5.1.16) 


On  the  range  OSxi  j,  |H(t+j+l-x)-H(t+j-x)  -  t— j  is  o(t~m) 

by  Theorems  3  and  4  of  Smith  (1959)  since  ft  .  <  ®.  Thus  the  first 

m+i 

summand  in  (5.1.16)  is  o(t"m)  and  the  second  is  o(t-m-1).  The 


result  follows.  □ 

-o?t  _t 

In  Lemma  5.2  we  found  that  £e  =  e  [w-(l-w)H(t)].  This 
function  is  of  bounded  variation  in  every  finite  interval  and  thus 
its  Laplace-Stieltjes  Transform  exists. 


Lemma  5.6 


-  *a?t 

L(Ee  t}  = 


(a-s) [l-F*(s)j 


Proof : 


-1  *  'a5t  0  -  _a?t 

s  L(Ee  t}  =  L  { Ee  *} 


3  r  r  e*ste’°(x't)d^x)dt + r  i  r  e^v^^^dfMdHCTjdt 

0  t  0  0  t-  t 

-  r  e"ax  f  etC<7's)dt  dF (x)  +  f*  e"aTf°  e_oy  T  yet(CT"s)dt  dF(y)dH(x) 

Jo  Jo  J0  J0 

*  (a-s)-1  f(e-sx-e'ax)dF(x)  ♦  (a-s)"1  fe"ST f(e"sy-e-ay)dF(y)dH(T) 

J0  '0  J0 

=  (a-s)”1 [F*(s)-u] [1  +  H*(s) ] 


„  F*(s)-<>> 

(a-s) [1-F*(s) ] 


since  H*(s) 


XtLL. 

1-F*(») 


(5.1.17) 


Returning  to  expression  (5.1.11),  we  have 


E[N(t)(k)lA(t)«l] 


(t). 


(5.1.18) 


-fk") 

From  Smith  (1959),  '(t)  is  asymptotically  a  kth  degree  polynomial 

in  t.  Given  Lemma  5.5,  it  is  reasonable  to  expect  E[N(t)k|A(t)=l] 
(and  hence  E[N(t)^|A(t)»l))  to  be  a  kth  degree  polynomial  in  t  whose 
leading  coefficient  is  the  leading  coefficient  in  k!H^(t)  if 
<  00 .  Our  arguments  to  this  effect  depend  upon  the  following 
lemma. 


Lemma  D  (Smith  1959) 

A  necessary  and  sufficient  condition  for  the  proper  distribution 
F  of  a  non-negative  random  variable  to  have  its  first  k  moments  finite 
is  that  there  exist  another  distribution  function  F^  such  that 


*  u2  2 
F  (s)  -  1-WjS  +  ~  s^ 


•••  + 


Mk-1 

(k-l)l 


(s) 


for  real  s  >  0. 


(5.1.19) 


In  fact,  F  (s)  *  1-y.s  ♦•••  ♦  -r(-s)  F,.(s)  for  1  s  r  s  k 

1  r:  (r) 

F^rj,  the  rth  derived  distribution  of  F,  has  k-r  finite  moments.  The 
jth  moment  of  F ^  is  a  rational  function  of  Uj,  ...,  ur+.. . 


Theorem  5.1 

Suppose  F  e  C  and  02  <  «.  Then 
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t*  • 


Proof : 


i 


From  (S.1.11)  we  know  that 


E[N(t)|A(t)-l]  =  j 


t  -  "^t-T  - 
Ee  x  <!H(t) 


6e 


Consider 


<Kt)  »  I  le  T  TdH(t)  -  K  (o)H(t) 
J0 


**(s)  *  C»1  .  K*(a)H*(s)  by  Lemma  5.6 

(a-sHl-f  (*)] 


.  a*  (s)  [  stF  W;“l  -  iatj. 

(o-s)[l-f  Cs)]  oSj 


By  Lemma  D, 


F  (s)  *  1-j^sF^  (s)  ■  1-OjS  ♦  -y-  s2F(2)  ’ 


which  implies 


& 


*  1-di  ^2  1  -* 

lim  *  (s)  »  -[*=-  *  -  -  t— — ]  lira  sH  (s). 

.  cu.  L2u.  0  1  — u>  « 

s+0  M1  W1  s+0 


But 


lim  sH  (s) 
s+0 


sF  (s) 


lim 

s+0  1-F  (s)  s+0  OjF^  (s) 


F*(s)  .  -1 

lim  — v  / —  *  y« 

.  1  A  A  P  t  ~  ^ 


(5.1.20) 


(5.1.21) 


(5.1.22) 


(5.1.23) 


Therefore 


1-W  r  M2  .  1  1 


(5.1.24) 


and  hence 


2  1  1 


E[N(t)|A(t)«l] 


K  (a){H(t)  +  2  +  „  -  .  } 

^  '  2 vl  cuj  l-o) 


+  o(l). (5. 1.25) 


From  Smith  (1954), 

H(t)  -  ^  1  ♦  o(l) 

U1  2  c2 

and  Lemma  5.5  guarantees  t[Ee  -K  (a)]  -►0.  Thus 


E[N(t)  A(t)-1]  .  .  A-  .  .  o(l) 

U,  0,  1 


The  method  employed  in  Theorem  5.1  can  be  used  to  derive  forms 
for  higher  cumulants.  However,  the  computations  involved  become 
increasingly  burdensome  as  the  order  increases.  For  example,  to 
find  the  conditional  variance,  we  begin  with 


ft  c/°?t-W2)  fx'l 

E[N(t)  (N(t)-l)  |A(t)-l]  -  2  £2 - 


(5.1.26) 


If  P3  <  ",  we  can  show  that 


2 - -  fl(t)[-S-  *  -4-  -  r!-1 

-a;  v  ’  v  -.2  ay.  l-uJ 

Ee  *  vl  L 

iV4-X. 


1  1 


(5.1.27) 


The  argument  depends  heavily  upon  Lemma  D  and  the  distributions 
^(1)*  ^(2)*  an<*  ^(3)'  Combining  this  result  with  Theorem  S.l  and 
Smith's  work  on  the  cumulants  of  proper  renewal  processes,  we  dis¬ 
cover 


E[N(t)2  -  (E[N(t)|A(t)*l]2|A(t)=l]  = 

/VfjV  2g2  ^3  !2_+^2_ 

1  J  f  .4  ‘  .3  ‘  .2  „.3  ' 

\  W1  /  W1  W1  V1  Cul 


J_+  J_ 

ou,  2.2 
1  a  u1 


(1-w)' 


-  ♦  o(l) 


(5.1.28) 

In  the  next  sections  we  provide  a  preferable  method  of  deriving  the 
cumulants.  We  prove  they  are  asymptotically  linear  in  t  and  find 
properties  of  their  error  terms. 


5.2  THE  CONDITIONAL  $ -MOMENTS 

Smith  discovered  asymptotic  formulas  for  the  cumulants  of  a 
renewal  process  by  studying  what  he  called  the  <J> -moments  of  the 
process : 


♦r(t)  «  E[N(t)+l] [N(t)+2] • • • [N(t)+r] 


(5.2. r 


These  moments  have  generating  function 


If  0  <  «,  then 

n 

n  rJ 

♦*.(0  -  1  +  I  M*)  fr  ♦  o(;n)  as  ?-*-0 


(5.2.2' 


and  *  log  *t(0  admits  the  expansion 


l  4.(t)  fr  +  o(5n). 

j»l  J  J- 


(5.2.3) 


The  coefficients  4j(t)  are  called  4-cumulants  of  N(t).  By  working 

with  4-moments  and  4-cumulants  rather  than  conventional  moments  and 

cumulants,  one  bypasses  certain  computational  complexities.  The  rth 

conventional  cumulant  k  (t)  is  a  linear  combination  of  4, (t ),••*, 4  ( 

r  l  r 


kj (t)  *  ^(t)-! 


n-1 

k(t)  =  l  (-l)V  .4  .(t),  n 

n  jsQ  n*n‘J  n_:} 


a  2 


(5.2.4) 


where  the  t^s  are  Stirling's  numbers  of  the  second  kind.  See 
Smith  (1959)  for  details. 

We  will  study  the  conditional  4-moments  and  4-cumulants  of 
transient  renewal  processes  and  then  relate  our  results  to  the 
ordinary  conditional  cumulants,  which  we  specify  up  to  an  eiror 
term.  Let 


4nc(t)  *.E[(N(t)+l) • • • (N(t)+n) |A(t)-l] 


,  He  r[N(t)^l].. 


■ fN(t)*n] 


Ee  t*4n(t) 


(5.2.5) 


by  Lemma  5.3. 


Consider 


_  s[oj-F*(s)]5  (s) 

L(Ee  «4-n(t)} 


(s-o)[l-F*(s)] 


(5.2.6) 


by  Lemma  5.6.  Our  goal  is  to  rewrite  (5.2.6)  as  a  linear  combination 


of  $n(s)»  $n  j (*),•••,  (s)  because  Smith  carefully  studied  the 

properties  of  $n(t),***,  4>^(t)  in  his  1959  paper. 

Suppose  n  is  a  positive  integer,  p  is  nonnegative,  and 


^n+p+1  <  °°*  ^ssurae  temporarily  that  s  >  a.  Note  that 


o»-F*( 


f  e-< 

ll _ !° _ 


s-o)x 


dF(x) 


s-a 


S-0 


Jn 


e-(s-o)xdx  _  (S.0)‘1F*(S.0) 


r*  _-sxf.ox 


Jo 


(eax [u-F(x) ] }dx  =  J  e*sxL(x)dx.  (5.2.7) 

J  n 


Since 


r 

Jn 


eaxdF(x) 


1,  L(®)  *  lim  e0X[w-F(x)]  *  0 
x-*°° 


and  hence 


f°  xn+P+1|dL(x)|  *  [*  [  (n+p+l)yn+PdyjdL(x) 
Jn  J0  J0 


•  (n+p+1)  f"  yn+PL(y)dy  *  (n+p+1)  f°  yn+Peoy[co-F(y))d\ 
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*  (n+p+l)J~  j"  yn+^ea^dF(x)dy 


<f  xn+P+1e0XdF(x)  =  y 
J0 


n+p+1 


(5.2.8) 


Therefore 


sL°(s)  =  L*(s) 


is  the  Laplace-Stieltjes  Transforms  of  a  function  of  bounded  varia¬ 
tion  on  [0,«)  having  n+p+1  absolute  moments.  The  transform  L  (s)  is 
defined  throughout  the  half  plane  R(s)  >  0;  the  integTability  of 
L(x)  and  the  identity  L  (s)  *  sL°(s)  imply  that  L  (s)  *  0(|s|)  as 
|s|  -*-0.  Thus  given  <  09  and  F  e  C,  Theorem  G  of  the  appendix 

applies  with  m  *  n  +  p  and  q  =  1.  It  follows  that 


s[y_-I*(s)] - ,  ,  a  D*(S)  -  a2D*(s),  s  >o,  (5.2.9) 

(s-a) [1-F  (s)]  1-F  (s)  11 


where  and  D 2  are  distributions  on  [0,*)  having  n+p  finite  moments. 
Notice  that  the  Tight  hand  side  of  (5.2.9)  is  an  analytic  function 
throughout  the  half  plane  R(s)  >  0.  Thus  equation  (5.2.9)  must  hold 
for  R(s)  >  0. 

Let  the  first  n  moments  of  D,  and  D,  be  v..,  v. _,•••,  v,  and 

i  a  11  iz  m 

v2i»  v22’***'  v2n’  We  can  wr*te 


*  vi2*2  '’in'-51"  * 

DJ  *  4t~ . -^TT-  W5) 


(5.2.10) 


where  D.,  «  is  the  nth  derived  distribution  of  D.,  j  *  1,2.  D.r  . 
Din)  —  3  J  U») 

has  p  finite  moments. 

Define 

*  fl2s2  °n('s)n  Vl('s)n+1 

Q(s)  »  1-f  (s)  -  V  4 r  * - ^ - (n+l~  W* 


(5.2.11) 


We  can  rewrite  (s)  as 


D/CS)  -  1  .  X  Q  X.nQ"  .  Rjn*(s) 


(5.2.12) 


where  the  A.'s  are  chosen  to  make  the  coefficient  of  s  in  A.  .(>•••  + 
J  jl 

A^nQn  equal  to 


V-1) 


k  * 

the  coefficient  of  s  in  (s),  1  s  k  s  n. 

Let  L.*(s)  =  1  ♦  A.lQ  .  A.nQn,  j  -  1.  2. 


Lemma  5.7 

Lj (t)  is  a  linear  combination  of  distribution  functions  on 


[0,«)  having  n  +  p  +  1  finite  moments. 


Proof : 


L.*(S)  -  1  ♦  I  A  Qk  -  1  *  l  A  [1-F*(s)]k 
J  k»l  J  k*l  J 


1  +  l  *ik  I  (k)(-l)£f(£)*(s) 
lc«l  J  fc«0 


n  Tx  /  *  %  a  n  *  * 

*  1  +  l  \-W  +  I  FC  3  (s)  I  C^C-l)*Ajk. 


k=l  1=1 


Define 


-  1  ♦  I  »(V;  y,,  ■  I  (b(-i)\v 


jk’  'ji 


k:t  7  J** 


j  .  * (s)  =  Y  +  l  Y.9F(a)’ 
J  JO  ^  JjZ 


and  hence 


yt}  •  vct)  +  v  (t) 


(5.2.13) 


We  remark  that 


j  xn+p+l^~ (1)  ^  <  £or  ^  ^  j  since  ji  , 
J o  n+p+1 


As  a  result  of  the  last  lemma. 


*  n  n+ 1  * 

L.  (s)  =  1+O..S+* • *+a .  s  +a.  ,s  l. ,  ,.(s) 

1  jl  jn  a;j,n+l  j (n+1) v  J 


(5.2.14) 


where  L^n+^(t)  is  a  linear  combination  of  distributions  having  p 

finite  moments.  But  from  the  definition  of  the  A.'s,  we  must  have 

J 


Vik(-X) 

a.,  *  — n —  .  1  s  k  s  n. 
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Thus 


>n 


*  yin^“s^  n+1  * 

L.  (s)  -  l-vns  «•••■>  -3-n--  *  »j Lj(n<1)(s).  (5.2.15) 


From  (5.2.10)  and  (5.2.15)  we  conclude 


,n 


*  *  *  vinC~s)  . 

"in  <s>  *  Dj  W-Ll  ts)  ■  -JV-I W5’11 


a .  ,  s11  .  r  , ,  (s)  . 

j,n+l  j (n+1)  J 


Now  define 


Xk  '  alXlk  '  a2X2k;  X0  "  al  "  a2  ; 


Rn  (sl  S  “lRlnM  -  a2R2i.ts) 


By  equations  (5.2.9)  and  (5.2.12)  we  have 


Lemma  E  (Smith  1959) 


♦n  (s)  s  n!Q(s)‘n. 


Lemma  5.8 


If  0n+p+1  <  »,  p  s  0,  and  F  e  C,  then 


s[w-F*(s)]i  (s)  n  _  *  n!R  *(s) 

- * -  *  I  nn,iV4)  i. (s )  +  - ; - — 

(s-a) [1-F  (s) ]  k=0  (k)  k  n‘k  [1-F  (s)]n 


(5.2.16) 


(5.2.17) 


100  - 


Proof: 

The  expression  follows  directly  from  expression  (5.2.17)  and 

Lemma  E .  □ 

When  we  invert  the  transforms  in  Lemma  5.8,  we  will  find 
-  -«t  „ 

Ee  *4>n(t)  is  a  linear  combination  of  $  (t),***,  ^(t),  a  constant 
term,  plus  an  error  term.  We  will  prove  the  error  term  belongs  to 
a  particular  class  of  functions. 

Let  m  2:  0  and  ¥(t)  be  a  function  on  [0,»).  We  say  fCt)  belongs 
to  the  class  B(m)  if  and  only  if  it  is  of  bounded  total  variation  and 

tm|d'Y(t)  |  <  «  . 

It  is  clear  that  if  f(t)  e.  B(m)  and  fC®)  =  0,  we  may  write 

Y(t)  *  (5.2.18) 

(l*t)B 

where  A(t)  is  of  bounded  variation,  tends  to  ;ero  as  t  approaches 
infinity,  and  if  n  2  1,  belongs  to  the  class  L^. 


Lemma  5.9 


If  <  »,  p  2  0,  and  F  «  C,  then 


[l"F*(s)  ]’ 


T  (s) 


where  'i'(t)  e  B(p)  and  ¥(»)  =  0. 


Proof : 

It  is  sufficient  to  show  that 


R.  (s) 

J"  - 

[1-F*(s)]n 


has  the  described 
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properties.  Identify  p  with  m  and  n  with  q  in  Theorem  G.  We  have 


1)  F  £  C  and  0  ,  <  ». 

p+1 


2)  R.  (t)  *  D.  (t)-L.(t)  is  a  function  of  bounded  variation 
J  **  3  3 

on  [0,«)  having  n  +  p  absolute  moments  since  and  are  such 
functions.  Also, 


Rjn  (s)  *  o(|s|n)  as  | s |  0 


by  equation  (5.2.16).  Theorem  G  implies 


n  '  Vs> 


where  'i’j(t)  e  B(p). 


Rin  (s) 

’?.(«)  »  o  since  lim  —■■■*■  =•• - *  0. 

3  | s  |-K)  [1-F  (s)]n 


□ 


We  now  want  to  find  explicitly  for  k  *  0,1, 2, 3  and  indicate 

its  general  form  for  higher  values  of  k.  We  learned  in  equation 
(5.2.17)  that  when  0 


n+p+1 


<  00 


s  [u>-F  (s)  1 
(s-o) [1-F*(s) ] 


=  *0  +  **"+  xnQn  +  o(sn)  as  s  ■*>  0. 


First  we  rewrite 


m-P (s) 


n 


(s-^pjf  ^j(s)  j*0  3 


•  y  c.sJ  +  0(sn)  as  s  •*  0. 


(5.2.19) 


We  have  derived  for  j  s  4  by  using  properties  of  the  derived 
distributions  of  F. 


C  s 

o 


1-in 


ay. 


1-0) 

-  I  4 

(1-oj)  S2 

C1 

2, 

a  flj 

a 

2aC12 

1-0) 

1 

Cl-a>)  02 

(l-o))y3  (1-oj)  y^2 

C2 

3. 

a  yj 

2 

a 

2a2y12 

A  ~2  t  A  -  3 

6ay^  4aUj 

1-0) 

1 

(l-<o)y2 

• 

(l-o))y3  (l-o))fl4 

(l-w)O. 

C3 

4. 

a 

3 

a 

3 

2a'iy1“ 

2  2  +  2  + 
6a  fjj  24ay^ 

„  2,  . 
4o  yj 

.  2 


(l-a))O203  (l-u)023 


6ay_ 


8oa, 


l  (l-«)32  (l-«)fl3  ti4  (1-w)  y 

c4  *  ~ "  ~  +  4  T~  ~  3  T~  *  2  2  ~ 

o  Pj  a  2a  fij  6a  y^  24a  120ai^ 


In)|  tn  oi  n> 


Notice  that 


^ .  4 1 — ^ 


«  [ _ u,~r  _ ] 

dsk  (s-o)aiF(1)*(s) 


and  hence  is  a  rational  function  of  the  first  k  moments  of  F  and 
F^.  That  is,  c^  »  ,  where  ^+i  represents  any  rational  function 

°f  tij.  a2,***,  ok+1. 

Now  to  find  the  X's,  we  equate  coefficients  of  powers  of  s  in 


the  equation 


n  n 

l  X.Q(s)J  ♦  o(sn)  -  l  c.sJ  ♦  o(sn) 

j«0  3  j»0  3 


(5.2.20) 


We  find 


0  ofl, 


i-„  i  f1-"50: 

Ai  ~n  ■  ~  ,  -  i 

a  Uj  oOj  20UJ 


j_w  j  0  2  (l-o>)  0^  (l-o))u3  (l-o))u2i 

X2  *  3.  3  '  2.  2  ‘  7TT  +  2.  4  7  .  4  +  7  .  5*” 

o  Wj  o  Uj  2aVj  a  Uj  601^  2 ouj 


1-a)  1  *2  .  3(1_w)ii2  °3  (1_u>)a3 

X3  *  2.  4  ”  3,  3  "  2.  5  +  *  -  +  ‘  51  ~ 


27  4  37o  2.  4  -  3.  5  ,  .  4  .  2.  5 

a  Uj  o  Wj  o  uA  2a  Uj  6avj  ao  Uj 


(1-U))0.  0^^  5(1-O))0,2  5(1-U))O_0,  5(1-U))0  3 


and  the  coefficient  of  s  in 
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In  general,  »  Yk+1  since  ck  *  Yk+1 


Qk  *  [a1sF(1)*(s)]k 

will  be  of  the  form  • 

k 

Lemma  F  (Smith  (1959) 

If  8n+p+1  <  ®,  p  *  0  and  F  e  C,  then 


yt) 


♦ 


+  •  •  •  + 


Tn+1 


+  xCt) 
(l*t)p 


where  X(t)  is  of  bounded  total  variation,  is  o(l)  as  t  -*■  «,  satisfies 
the  condition 

A(t)  -  A(t-oi)  *  o(t_1)  as  t  +  « 


for  every  fixed  a  >  0,  and  when  p  £  1  has  the  additional  property 

that  €  Lr 


Theorem  5.2 

If  Cn+p+1  <  »,  p  ^  0,  and  F  e  C,  then 
E[CNCt)*l)tN(t)*2)-"(N(t).n)|A(t)-l) 

'  V"  *  V"'1  *•”*  Vi  *  °Ct'P)- 


10S  - 


■ 


i 

s 


» 

! 


! 


Proof: 


E[(N(t)+l)  •  •  •  (N(t)+n)  |  A(t)  ■!]  «  *n<;(t) 


n 


6e  k-0  n(k)Vn-k(t)+n!,|f(t) 


-a?. 


He 


K*(o) 


♦  o(t"n"P){  l  n(k5Ak^n_kCt)+n!y(t} 


by  Lemmas  5.5,  5.8,  and  5.9. 
Define 


°aixk 


*k 5  n‘wr\  ■ 


w  Tk+1 ' 


Then 


n 


*nc(t)  *  JQ  n(k)Vn-k(t)  *  0(t  5 


(5.2.21) 


1*"  *  V"'1  Vi  *  °(t'P) 


by  Lemma  F. 


5.3  THE  CONDITIONAL  CUMULANTS  OF  NCt) 

In  the  last  section  we  learned  that  when  En+p+1  <  ®»  P  2  °> 
the  nth  conditional  ♦-moment  of  NCt) , 

♦nc(t)  -  E[(N(t)+l) • • • (N(t)+n) | A(t)»l] , 

is  asymptotically  an  nth  degree  polynomial  in  t.  Let 


06  - 


■  EI(1.t)N<tW  1  Att)-11 

be  the  conditional  ♦-moment  generating  function.  When  On+p+j  < 
we  can  write 


*tc(0  "  1  +  I  fr  +  °(?n)  «s  ?  +  0 


j=Pc  3 


(5.3.1) 


n 


log*t  (O  =  ft  (O  *  I  *ic(t)  fr  +  o(?n)  as  C  +  0.  (5.3.2) 

jsl  J  J  • 

The  coefficient  ♦  (t)  is  the  nth  conditional  i|»-cumulant  of 

nc  — 

N(t);  discovering  its  asymptotic  form  is  our  next  task.  We  have 
that  ♦  (t)  is  the  coefficient  of  (n!)~*?n  in 


log(l  +  l  *.  (t)  4r  }  , 
j«l  JC 

which,  by  equation  (5.2.21),  is 


"  J  2  „  «  J  r.(t) 

log{1  *  l  fr  X  j(k)Vj-k(t)  *  .1  f t  t  n.P— >  (5-3-3’ 

j *1  J  k*0  J  j»l  J  (1+t)  r  J 


where  r.(t)  ->-0  as  t  -*•  «. 
J 

Let 


cj  5  JQ  j(k)Vj-*  (t)> 


From  the  Taylor  expansion  for  log(l+z),  we  know  ^(t)  is  the  co¬ 
efficient  of  (n!)’^cn  in 
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j  D  tM 


\  c  7  _ 3 _ 

jii  3  j!  j-i  (i+t)n+p-^ 


,  n  i  n  r.(t)  .2 

.i(J  e.  4»  y  - *  ... 

?  1  L  i  •  /.  n+n_  i  * 


j=l  3  3’  j«l  (l+t)n+P“3 


,  n  j  n  r.(t)  .  n 

*C-i)nlrU  c<  It  *  I  - (5.J.4) 


"  jli  jii  (i.t)n*P-) 


5  c  fi . i ( !  =  fi )2 . t-i)"*1  it ? «, £ ; 

j*i  3  3*  ^  j«i  3  3*  n  j«i  3  3* 


n+1  I  /  ?  ,  iiin 


♦  — ♦  terms  involving  mixtures  of  powers  of 
(l+t)P 


n  r.  (t) 


\  c .  -hr  and  £  — 
j«l  3  3‘  j-1  (1+t) 


n+p-j 


rC3  • 


(5.3.5) 


We  want  to  show  that  the  coefficient  of  5  in  the  mixture  of 
powers  can  be  represented  by  — ,  r(t)  +  0  as  t  *  •.  A  typical 


summand  in  the  mixture  is 


(1+t)1 


n  J  m  J  r.  (t)  .  q 

a«jfr>  a,  — Wr ;  } 

j«l  J  J  k«l  (1+t)  1 


(5.3.6) 


where  m  2  1,  q  U,  m  +  qsn.  We  now  bound  the  absolute  values  of 
the  coefficients  of  and  individually.  We  know  that  |c,.|  <  Mt3 
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and  |r^(t)|  <  r(t)  where  r(t)  *  o(l)  as  t  +  ».  Thus  the  coefficient 
of  (n!)”*;n  in  (5.3.6)  is  smaller  in  absolute  value  than  its  coeffi¬ 
cient  in 


n  .  m  n 


M“r(t)q  {  l  (t?)j>  {  I  — ~rr  (c(i+t))k>  •  (5.3.7) 


k»l  (l+t)‘ 


The  coefficient  of  (n!)"^^1  in  (5.3.7)  is 


(l-^t)  kn^pjq 

*  0(t"p). 


Therefore  'l'nc(t)  is  the  coefficient  of  (n!)-1?11  in 


n  _j  .  n  _j  2  .  .  n  i  n 

l  cjjr-|l  ^  cj  jr  >  +•••+  [-l)11*  -  (  I  c  fr  } 
j=l  3  3 *  1  j-1  3  3 '  n  j-l  3  3‘ 


(5.3.8) 


plus  a  term  of  the  form  o(t”p) .  But  we  recognize  the  coefficient 
of  (nt)  1?n  in  (5.3.8)  to  be  identical  to  its  coefficient  in 


n  j 
r  „  V 


log{l  +  l  c.  -tt  } 
j*l  3  3  * 


108(1  *  ji  fr  Jo  j(k)Vj-k(t)1 


-  log{l  +  l  z3  l  l  k1,  >  . 

j«l  k=0  K  u  KJ* 


(5.3.9) 


Recall  that  •  (y—)  *  1.  ^US  exPressi°n  (5.3.9)  is  simply 


ffi 


iogi  L  <•'  l  \  rn-kv  }- 
j«o  k»o  K  u  k)- 


(5.3.10) 


Since  ][ 


1  ^  "(jTkp-  a  tenn  in  the  convolution  sequence  of 


n  $k(t)  n 

{JL  }  and  { — r-7— }  ,  the  coefficient  we  seek  is  the  coefficient 

k«0  k«0 


of  (n!)"1?11  in 


?  i  2  MO  v 

V  o  r 2 1  r  r  k  -k 


logf[  I  I 

j*0  J  k» 


0  k! 


2  i  *  ♦vft)  w 

*  l°g{  J  £.CJ}  ♦  10g{  l  — -  ck} 

j*0  J  k*0  k! 


(5.3.11) 


We  recognize 


?  *k(t’  ,k  ,  .  ?  *k(t)  k 

i  — T7-  t  ■  1  *  i  -TT t 

, -A  ^  •  i__i  iv  • 


as  the  first  n+1  terms  in  $t(0»  the  usual  (f>-moment  generating 
function. 

Hence 


*ncU)  *  \  +  *n(t)  ♦  o(t-P) 


(5.3.12) 


where  nn  is  the  coefficient  of  (n!)"1;11  in 


9 

$ 

(.  - 

i 


<t 
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log{  l  l.j)  (5.3.13) 

j-0  : 

and  <i>n(t)  is  the  nth  )|>-cumulant  of  a  proper  renewal  process  whose 

lifetimes  have  distribution  ?.  We  can  conclude  n  =  Y  from 

n  n+i 

(5.3.13). 

Theorem  5.3 

If  n  is  a  positive  integer,  p  i  0,  F  e  C,  and  &n+p+1  <  °°»  then 
the  nth  conditional  cumulant  of  N(t)  is 

k  (t)  =  ic  (t)  *  p  +  o(t-P) 
ncv  '  nv  1  n  v  1 


*  V  * 


Tn+1 


+  o(t"p) . 


The  constant  p  is 
n 


rij  if  n  ■  1 


n-1 


l 

j-0 


(-1) 


j 


t 

n,n-j 


if  n  >  2. 


Proof: 

We  know  that 

(t)  *  n_  ♦  i  (t)  +  o(t'p). 
nc  n  n 

The  relationship  cited  in  (5.2.4)  between  <|>-curaulants  and  conventional 
cumulants  also  holds  between  their  conditional  counterparts.  That  is, 

kic(t)  -  *lc(t)  -  1 


(5.3.14) 
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n-1 


k  (t)  -  7  (-l)Jt  .  ip  .  (t),  n  i  2  . 

nc  j*0  n,n"J  n"3c 


Hence 


klc(t)  ♦  n1+o(t“p)=  kjCt)  +  r)t  *  oCt'p)  (5. 

n-1  __  n-1 

k  (t)  *  T  (-l)^t  .5  .(t)  +  T  (-l)^t  .n  .+o(t~p 

nc  j*0  n,n-j  n-j  j=0  n,n-j  'n-j 


kn(t)  ♦  Pn  +  o(t'p). 


(5. 


Finally,  we  appeal  to  Smith’s  1959  theorem  on  the  cumulants  of 
renewal  processes,  which  was  quoted  in  Chapter  1.  It  ensures 

in(t)  *  V  *  Vl  *  0(t'P’ 

given  our  hypotheses.  □ 

In  order  to  derive  the  correction  factor  p  of  Theorem  5.3, 

n 

we  must  find  nn»  the  coefficient  of  (n!)_1?n  in 
n 


log{  I 

j*0  3 


ay. 


By  definition,  l.  *  —  A.  and  thus 
j  l-<u  j 


S*1 


oy. 


1  M  2 

- ♦  — 

1-w  2jjj 


3.15) 

) 

3.16) 


Using  the  previously  derived  values  of  the  ji's  we  have 


n,  = 


_1 _ L.  +  _2_ 

aO,  1-oj  ..2 

1 


,.2 

3u2  1 


2.2  .3  ,.3 

a  Uj  aVj  3p ^ 


(1-a))  2 


30, 


n,  *  -? 


3  *4 

+ 


5.3  , 3  2.4  .4  '  4 

a  Uj  (l-o))  a  Uj  (JUj  4u1 


3»2 


.5 

aul 


2Vs  + 


.5 

U1 


20 


Corollary  5.1 


If  02+p  <  ®,  p  2  0  and  if  F  e  C,  then 


E[N(t)  |  A ( t)  =  1  ] 


-L  +  -i  +  -J— 

U1  o2  avi 


fa  * 


Proof : 


E[N(t)|A(t)-lj  =  klc(t)  =  kx(t)  ♦  rij  ♦  o(t'p) 


k  (t)  =  H(t)  -  ip  ♦  -=y  -  1  +  o(t'P) 
1  U1  20^ 


by  Smith  (1959)  and  thus  the  result  follows.  Note  that  this  formula 
agrees  with  the  one  derived  in  section  5.1  by  different  methods. 

□ 


Corollary  5.2 


If  Oj+p  <  »,  p  2  0  and  if  F  6  C»  then 
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Var[N(t) |A(t)  =  1] 


=  ( 


-2 

.  3  J 
U1 


Proof : 

Var[N(t) j  A(t)=l] 


°2  =  n2_nl 


and  by  Smith  (1959), 

.2 


-7-2 

2U2 

°3  C2  °2 

1 

1 

U) 

.4 

W1 

.3  .2  .3 

U1  W1  0U1 

2.2  '  .  " 
o  CU^ 

(1-w)2 

1=1]  = 

k2c(t)  =  k2Ct‘I  + 

P2  +  0(t-p) 

fl3  a2  p2 

— —  w  —  '  i  4  x 

1 

1 

(Jj 

4uJ 

,-3  2  .3 

3-^j  2^1  ouj 

2.2  .  " 

o  Uj  OUj^ 

(l-o.)2 

--P. 


k2(t) 


C2‘°l  502 

*  T* 

U1  4yl 


2C3  u2 

- 2  +  0(t  P) 

2C1 


The  result  follows  and  agrees  with  the  independently  derived  equation 
in  (5.2.28).  q 

If  we  are  interested  in  higher  cumulants  we  can  proceed  in  this 
same  way.  For  example, 

k3c^  *  ^3^)  +  n,  -  3n2  +  +  o(fP) 


whenever  <  »  and  F  e  C. 

The  form  for  k3(t)  can  be  found  by  the  methods  outlined  in 
Smith  (1959)  and  the  correction  factor  has  already  been  derived.  We 


find 
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*3c(t) 


That  is. 


MJ  °3 

«-4-  -4 

*1  < 


-)f  *  -± 
h  4gl 


SC2fl3 


wl  20j 
,-6  * 

2“l  »i 

4gJ 

g2 

-  ~2  } 

2gl 

,  °4  2t2°3 

+  !!i 

.fi.sL 

°2 

..4  .5 

4ui  ui 

-.6 

2U1 

»i 

2g? + 

2  2 

3g2 

°3  3»2 

3 

3.3  .3 

flj  (1-ui) 

2.4 
a  Uj 

'  «'4  +  -5  ’ 
OUj  oy 

2.2 
a  ux 

3  *  _L_ 

-  1 

)  +  o(t-P) . 

(1-u)2  oOj 

1-U) 

3D2  g3 
-  ( — £  — -  . 

'•  5  4 

3g2 
t  " 

~)t 

k3c^)  -  C-r  -  -4  -  -4 


gl  °1 


7g2g3  +  8g2  303  6g2  g2  2 
n5  ,6  ,3"  .4  +  .2  +  3.3 
U1  W1  U1  U1  W1  a  W1 


(!-«)' 


Ji  M 

.4  +  .5 

OVj  (JUj 


_2  +  3 


(!-«)' 


—  ♦  o(fP) 

1-w 


We  will  confirm  this  last  formula  in  Chapter  6, 


(5.3.17) 


4 


CHAPTER  6 


THE  CONDITIONAL  CUMULANTS  OF  CUMULATIVE  PROCESSES 

6.1  INTRODUCTION 

We  want  to  investigate  E[W(t)n| A(t)*l]  and  the  conditional  cumu 
lants  of  the  transient  cumulative  process  W(t) .  We  know  that 

E[»ctj“iAtt).i]  .  is — . 

8.  * 

In  the  last  chapter  we  were  concerned  with  the  special  (Type  B) 
cumulative  process 

N(t) 

W(t)  =  N(t)  »  l  1 

and  found  that  in  this  case 

-a?  -oc 

Ee  ^(t)"  =  ge  %EW(t)n. 

,  -a? 

The  fact  that  Ee  lW(t)  is  the  Stieltjes  convolution  of  two  fami¬ 
liar  functions  explains  the  success  of  our  Laplace  Transform  attack. 

In  this  chapter  we  shall  restrict  ourselves  to  general  Type  B 
processes 

Nftj 

W(t)  -  l  Y 
3*1  J 

for  we  shall  find  that  whenever  E ( Y. j n  <  », 
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-o?  -05 

Ee  ^(t)"  «  Ee  t*EW(t)n 

and  the  Laplace  Transform  is  again  effective. 

Suppose  W(t)  is  built  from  the  iid  sequence  (X^ ,  Y^,  (X2>  Y2), 
...  where  G(x,y)  is  the  joint  defective  distribution  of  (X^.Y^).  Let 
F(x)  ■  G(x,»)  and  assume  F(«)  *  w  <  1.  As  in  the  last  two  chapters, 
we  assume  there  is  some  a  >  0  making 
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•  rSn+l  -(s-o)t  -aS  ,+i9/,Y. 

E  I  e  e  n+1  5sl^dt 

n*0  JS 


U  e 
n=0 


Ayiei,  Y<  rSn+1  -fs-o)t 


n+l  j 


1 1 L 


n 

«  -aS  .+i0.^  Y.  -(s-o)S  -(s-o)X  . 

(s-c)-1  El  e  n+1  3-1  J  e  n(l-e  n+1) 

n=0 


n 

co  -sS  +i9  £  Y.  -oX  .  -sX  , 
(s-c)'1  I  £  e  n  J*1  J  [e  n+1-e  n+1] 

n=0 


n 

,  -  -sS  ♦H.i.Y.  -cx  ,  -SX  ,, 

Cs-c)'1  l  C[e  "  J*1  3]E[c  "‘"-e 

n*0 


since  (X  ,Y  )  is  independent  of  (X  ,Y  )  for  n  i  m. 
n  n  ram 


(s-o)”i[F*(o)-F*(s)]  l  e"(s,0)n 

n»0 


u-F  (s) 


Cs-a)(l-G  (s,0)) 


Next  we  consider 


L°(Uim(th  ■  f  .-”eeie  J-1  YJ  « 

Jn 


(6.1.1) 
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s 


% 


n 

-  r°n+l  _  iej,  Y. 


..  I  v  S 

•  f  n*i  in-",  *.  *  i9.fc.  i.  r  : 

t  e”st  e  3,1  3  dt  -  E  I  e  3'3  3 

n*0  'S  n*0  'S 


e‘Stdt 


n 

os  -sS  +i9.^  Y.  -sX  . 
s-1E  l  e  *  J(l-e  n+1) 

n*0 


n 


os  _ss  +ie.^  y.  -sx  . 
s'1  l  Ee  n  Jsl  J  E(l-e  n  *) 
n=0 


_ kf  (s) 

S [1-G* (s , 9) ] 

From  Lenana  5.6  we  recall 

uee'ott). 

(s-o) [1-F  (s)  ] 

and  therefore 


(6.1.2) 


n  -0?  +i9W(t)  _  -a?  »  _  i9W(t) 

l  (Ee  z  }  =  L(Ee  T>L  (Ee  }  .  (6.1.3) 

If  E | | n  <  ®,  we  can  conclude 
n  -o; 

L  {Ee  ^(t)"}-  L(Ee  t>i.°{EW(t)n}  .  (6.1.4) 

EW(t)n  is  of  bounded  variation  in  every  finite  interval.  Hence  its 
Laplace-Stieltjes  Transform  exists  and  we  have 
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(.{Ee  ?tW(t)n}  -  s(.°{Ee  ?tW(t)n)  =  sL(Ee  °Ct}L°{EW(t)n} 


-  .  -oc 

(.{Ee  z}  L{EW(t)n}  =  Li Ee  x*EW(t)n>  . 


(6.1.5) 


By  the  uniqueness  theorem  for  Laplace  Transforms  we  conclude 

-o?  -o? 

Ee  SfCt)11  =  Ee  t*EW(t)n. 


To  study  the  properties  of  E[W(t)  |A(t)  =  1],  we  study  the 

Laplace  Transform  of  its  numerator,  which  we  have  just  found  to  be 

-  0  -  n  - 

s L  {Ee  L  (EW(t)  }.  We  examined  (.{Ee  in  the  last  chapter 

and  thus  focus  our  attention  on  L^{EW(t)n).  A  special  notation  for 

W(t)n  will  help  us  calculate  its  transform. 


W(t)  «  l  2  (t)Y  where  Z.(t)  ■  (1  if  S.  st 


fil  3  3 


otherwise 


W(t)n  «  [  l  2 • (t)Y. ]n. 
j«l  3  3 


Consider  the  particular  case  n  =  3. 


W(t)3  -  [  l  Z  (t)Y  2  ♦  2  l  Z.  (t)Y.Y.  ]  [  l  1  (t)Y  ] 
j«l  3  3  j>k2l  3  3  K  1*1  1  1 


*  l  2  (t)Y  3  >  3  l  2  (t)Y  2Y  ♦  3  l  2. (t)Y.Y.  2 
j«l  3  3  j>k*l  3  3  K  j>k2l  3  3  K 


6  l  2.  (t)Y.Y.Y 


j>k2 1 


jv  '  j  k*Z 
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It(3)  ♦  3  It(2,l)  +  3lt(l,2)  ♦  6j(l, 1,1) 


In  general, 


W(t)n  -  It(n)  ♦nJt(n-l,l)  +  ***+n,.Jt(l, !,•••,!)  .  (6.1.6) 


A  typical  summand  in  (6.1.6)  is 


Pl„  P2 


cLCPj.-'-.PiJ  «  c  l  2  (t)Y  XY  *  *  *Y 

z  1  lc  r,  >r,>*  •  *>r.2: 1  rl  1  r2  r: 


Jv 

where  £  p.  *  n  and  c  is  a  constant  depending  upon  (Pj» * • • ,pk) • 
j*l  ^ 

This  notation  is  adapted  from  notation  Smith  developed  for  Type  A 


processes  in  his  1979  technical  report. 

Let  S(p1,***,pk)  =  L°(E^t(p1,***,Pk)}. 


(6.1.7) 


L°{EW(t)n>  »  S(n)  ♦  nS(n-l,l)  ♦  • • •♦n!S(l , • • *1) .  (6.1.S) 


Consider  the  term  S(plf • • • ,pk) .  Let  q  •  max(p^, • • • ,pk)  and  asstune 
.  1^  <  <*>. 


s(pt .  *  •  *pk)  ■  r  e"st  Eit(Pi’‘"'Pkidt 


*  r  e’st 
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& 


!! 


* 


-  E  l  P  (t)Y  ?1Y  P’..*Y  Pl 

Tj>» • *>r^2l  '0  rl  rl  r2  rk 

■  E  I  YrPl*‘*YrPk  f  e"Stzr  (t)dt 

^>•••>^*1  1  k  J0  1 


dt 


e  i  YrPi-YrPk  r 

rl>*’*>rk-1  1  k  Jsr 


e"stdt 


-1  r  -  Pi  ”®^r,  -*  ri -k 

-*  l  (EY  e  X)  *  *  *  (EY  e  ^(Ffs))1  . 

rl>‘**>rkil  1  k 

(6.1.9) 

We  could  interchange  the  order  of  integration  in  the  course  of  these 

p. 

manipulations  because  if  we  replace  each  term  Yr  ]  by  its  absolute 
value,  the  resulting  k-fold  sum  is  convergent. 


Define 


K* 


Ck(3)  S  W  G  (s*6> 


-  k  -sXi 

-  EY.  e  J  j«l ,2, • • • 
9*0  J 


Then 


S(P1,“*.Pk)  * 


“  *  r  -k  ri"l 

C  (s)---C  (s)s’1  l  F*(s)  1  {  l 


Vr1 


*1  pk 


rl*k 


^■k-l 


l  1> 


V1 


r,-k 


:  (s)---c  (s) s” 1  l  P*(s)  1  (r.-l) •••(r.-k+l) [ (k-1) ! ] 

P1  pk  r  -k  1  1 


.1-1 


Cn  CS)***C  Cs) 
pl  pk 

s(k-l)! 


r, -k+1 


I  F  («)  r 

—t.  1  A 


r^k-1 


(k-1) 


(s)  •  •  *C 

_ _ _ ^ 

s[l-F*(s)]k 


(6.1.10) 


Therefore  L{Ee  w(t)  }  is  composed  of  terms  like 


C  (s)---C  (s) 

P1  pk 


(»)] 

(s-o)[l-F*(s)] 


(6.1.11) 


If  we  assume  E|Y^j^  <  ®,  i^+p+i  <  *»  p  ^  0,  and  EX^+p|Yj|^  <  ®  where 
q  *  maxCpj^,  •  •  •  ,p^) ,  what  are  the  properties  of  this  term? 


In  Chapter  S  we  found  that  when  tf^+p+i  <  00 » 


,  X  ♦  A  Q  A  0k  ♦  R. *(s) 

(s-a) [1-F  (s)]  0  1  k  * 


where  R^Ct)  is  a  function  of  bounded  variation  on  [0,®)  having  k*p 
absolute  moments,  and  R  (s)  *  o(|s|k)  as  |s|  -►0.  If  we  write 


b*(s)  -  — fi*-L±*n 

(s-o) [1-F  (s)] 


then  Aq  *  B  (0)  ■  and  for  j  2  1  A^  is  a  rational  function  of  the 

first  j  moments  of  B(x)  and  F(x).  As  the  jth  moment  of  B(x)  is  a 

rational  function  of  A^  ■  Yj  +  1*  j  2  0. 

We  now  express  C  (s)  in  powers  of  Q. 
pr 

P„  "SX  f»  r~  p 


c  (s) .  ey  v  1 .  r  .-•*  r  /r8(dx., 

*  r  ^0 


Li  y  rG(x,dy) }  =  L(C  (x)}  . 


(6.1.12) 
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m 


The  assumption  EXjk*p|Yj|^  <  ®  implies  C  (x)  is  a  function  of 

pr 

bounded  variation  on  [0,®)  having  k*p  absolute  moments.  Therefore 
Smith's  Lemma  D  guarantees 

2  °kp 

Cp  ‘5)  '  %  '  “lp  S  *  S2p  3T  — fl - Cp  (k)(s) 

*  x  r  r  r  *x* 

(6.1.13) 

where  C  , (x)  is  a  function  of  bounded  variation  on  [0,®)  having  p 
PrW 

absolute  moments. 

By  the  same  argument  applied  to 

B*(s) .  .  , 

(s-o)[l-F  (5)1 


we  can  rewrite  C  (s)  in  powers  of  Q(s) . 
pr 

C  (s)  =  +  Q  +  ***  +  Y.„  Qk  +  D*  (s) 


°Pr  'IP, 


'kP, 


(6.1.14) 


where  D  (t)  is  a  function  of  bounded  variation  on  [0,®)  having  k+p 
Py  ^ 

absolute  moments  and  D  (s)  =  o ( | s [  )  as  |s|  0.  The  coefficient 

pr 

y.  is  a  rational  function  of  and  the  first  j  moments  of  C  (x) 
JPr  opr  J  Pr 

and  F(x).  That  is,  y.  is  a  rational  function  of  <  ,  jj, ,  •  •  •  ,  y . , 


IP 


P  1 
*r 


y 


““  V''  pjpr- 


Expression  (6.1.11)  consists,  in  part,  of  (s)***Cp  (s) 


*0,  *  v . Vk  *  °k(S)- 


(6.1.15) 


As  usual,  D^(t)  is  a  function  of  bounded  variation  on  [0,®)  having 

*  k 

k+p  absolute  moment;  D^(s)  *  o(|s|  )  as  |s|  0. 
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Hence 


C  (s).-.C  (s)  .. 

P1 _ pk  s[<n-F  (s). 


(s-o)[l-F  (s)] 


T  * 

+  " fe'-i  *  *+  +  'Sc 


*•"*  VVX1Q*'"*  XkQk  *  “k*'5’1 


Dk'(s)[S0*X1Q  *•••.  XkQk  * 


51  62  „  R*(s) 

7  +  ^+*“+  ^  ~ 


(6.1.16 


where  R(t)  is  a  function  of  bounded  variation  on  [0,®)  having  k+p 
absolute  moments.  In  addition,  R  (s)  =  o(|s|k)  as  |s|  -*■  0.  The 
coefficients  6^+1  are  rational  functions  of  5^+1* 

Kj,***,  and  (irs  for  r  =  l,***,  k  and  s  =  l,***,  q. 

As  in  the  last  chapter,  this  means  that 
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C  (s)---C  (s) 

-1,  P1  pk 


srco-F*(s)1 

(s-a) [1-F* (s) ] 


«iikW  +  Mk-i(t)+**’+  6k+i  +  nt) 


(6.1.17) 


The  function  ¥(t)  can  be  expressed  as 


Y(t)  *  — 

(l+t)P 


where  A(t)  is  of  bounded  variation,  tends  to  zero  as  t  approaches 

infinity,  and  if  p  2  1,  belongs  to  the  class  Lj . 

Thus  far  we  have  focussed  our  attention  on  just  one  of  the 
-o? 

summands  in  6e  SfCt)11.  If  we  are  to  make  statements  similar  to 

-o?t  n 

(6.1.17)  about  all  the  terms  making  up  Ee  W(t)  ,  we  must  broaden 
our  assumptions.  Equation  (6.1.17)  depends  on  the  suppositions: 


1}  Vp+l"  * 


2)  |q  < 


3)  EX1k+P|Y1|q  < 


We  need  1,  2,  and  3  to  hold  for  all  possible  partitions  (p^,***,  p^.) 

of  n.  The  largest  possible  value  of  q  arises  when  k  =  1  and  q  *  p  =  n. 

Thus  we  must  assume  £|y, |n  <  «  and  u  .  <  ®.  As  for  the  assumption 

1  n+p+i 

that  EXj^^jYjl^  <  »,  note  that  q  £  n+l-k.  Hence  we  require 
EX1r+p|Yi | s  <  ®  for  r+s  s  n+1,  s  ^  n,  and  r  £  n. 
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t; 


w 


% 


Lemma  6.2 

Let  n  be  a  positive  integer  and  p  i  0.  Suppose  <  ®, 

E | | n<  ®,  and  EX^r+^|Y^|S  <  ®  for  r  ♦  s  s  n  +  1,  s  s  n,  and  r  s  n. 
Then 


Ee  ”Vt)"  =  *  SjVift) . S„.l* 

(l+t)^ 


where  A(t)  is  of  bounded  variation,  tends  to  zero  as  t  approaches 
infinity,  and  if  p  >  1,  belongs  to  . 

The  coefficients  5^,***,  6n+^  are  rational  functions  of 
» *  * • ,  q  j,  <1>***,  <n>  and  0rs  for  r  +  s  £  n  +  1,  r  <  n,  and 
s  s  n. 


Theorem  6 . 1 

Suppose  F  €  C  ,  n  is  a  positive  integer,  and  p  >  0.  If 
un+p+i  <  09 »  E  |  Y1  |n  <  ®,  and  EXir+^|Y1|s  <  °°  for  r  +  s  <  n  +  1, 
r  <  n,  and  s  s  n,  then 

E[W(t)n|A(t)  =  1] 


■  V"  *  V"'1  —•*  s„»i  * 

The  coefficients  5,,  <$.,•••,  5  are  rational  functions  of 
1  2  n+i 

w , ,  •  *  * ,  ii  <.,♦•*,  <  ,  and  the  product  moments  u  for  r  +  s  <  n  +  1, 
i  n+i  in  rs 


r  s  n,  and  s  s  n. 
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Proof : 


E[W(t)n|A(t)=l] 


W(t) 


n 


n+1 

{  l 

k=l 


^k^n+l-k 


(t) 


X(t) 


(1+t) 


ay, 

p> 


(6.1.18) 


by  Lemma  5 . 5  and  Lemma  6.2. 

Since  F  e  C  and  y  ,  <  the  conditions  of  Lemma  F  are  ful- 
n+p+l 

filled.  Hence 

♦r(t)  =  Yxtr  +  Y2tr"1  +•••♦  Yr+1  *  o(t'n+r‘P)  (6.1.19) 

for  1  £  r  £  n.  The  result  follows  easily  from  (6.1.18)  and  (6.1.19) 

□ 


6.2  THE  CONDITIONAL  CUMULANTS  OF  W(t) 

We  have  learned  that  under  certain  conditions  on  the  moments  and 
product  moments  of  (Xj.Y^,  E[W(t)n|A(t)=l]  is  asymptotically  an 
nth  degree  polynomial  in  t.  We  now  turn  from  the  conditional  moments 
to  the  conditional  cumulants  of  W(t). 

Define 

M0c(t)  =  E[eieW(t)|A(t)  =  1].  (6.2.1) 

MQc(t)  is  the  conditional  moment  generating  function  of  W(t).  If 

ei  Yj  r  < 

Mfl  (t)  -  1  +  I  ni.(t)  -^r2-  -  o(0n)  as  0  -  0  (6.2.2) 
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where  m.  (t)  =  E[W(t)^ |A(t)«l] . 

Let 

Kec(t)  =  log  MQc(t) 

=  l  k.  ft)  ♦  o(0n)  as  0  -*■  0.  (6.2.3) 

j=l  JC  J- 

KQc(t)  is  the  conditional  cumulant  generating  function  of  W(t) . 

The  nth  conditional  cumulant  is 

knc(t;)  =  E  C(pl’“',pk)mp1cCt:>  *“mpkc(t)  (6.2.4) 

where  the  summation  is  over  all  partitions  n  anci  where 

c(Pj» *  *  * «Pk)  is  a  constant. 

Under  the  conditions  of  Theorem  6.1, 

p  p  -1  -n+p  -p 

m  c(t)  *  Sjt  r  +  o2t  r  +•••+  6  +1  +  o(t  r  ) 

pr  pr 

for  pr  =  1,  n.  Hence 

knc(t)  3  V"  +  V"’1  +"*+  Vl+°(t"P)*  (6.2.5) 

As  in  Theorem  6.1,  the  coefficients  5,,***,  5  ,  are  rational  functions 

1  n*l 

of  certain  moments  and  product  moments  of  (X^.Y^);  they  do  not  depend 

on  the  particular  form  of  the  distribution  6(x,y).  While  (6.2.5)  is 

valid  whenever  ii  .  <  «,  E I Y_  | n  <  »,  and  EX.t+p|y,  Is  <  »  for 
n+p+i  1  1  1 

r  ♦  s  £  n  ♦  1,  s  £  n,  r  s  n,  we  can  make  the  extra  assumption  that 

EX.0** I Y. |n+*  <  «.  Then  if  we  can  find  the  values  of  6 ,,•••,  6  , 

1  1  1'  1  n+1 
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in  this  restricted  case,  these  will  also  be  the  coefficients'  values 
in  the  more  general  case. 

Assuming  that  EX^** | |n+1  <  *,  we  can  say  that  S^,***, 

are  rational  functions  of  £irs  for  r  and  s  in  {0,1,  •  •  •  ,n+l} .  As 

2 

rational  functions  of  a  point  in  [(n+2)  -1] -dimensional  Euclidean 

space,  the  <S's  are  determined  uniquely  by  their  values  in  any  sphere 

in  this  space.  For  every  positive  integer  n,  we  shall  find  a  sphere 

in  which  6,, •••,6  ,  vanish  identically.  This  will  tell  us  they  are 

1  n-i 

also  0  outside  the  sphere  and  will  allow  us  to  conclude  the  nth 
conditional  cumulant  is 


(s) 


(s-o) [1-G*(s,0)] 


(6.2.6) 


by  equation  (6.1.1). 

Set  m  *  (n+2)fc  -  1.  In  his  1979  technical  report  on  the  curau- 
lants  of  proper  cumulative  processes.  Smith  discussed  sequences 
{(Xj.Yj)}  "generated  by  a  X-raodel.”  For  such  a  model,  the  proper 


-  131  - 


distribution  G(x,y)  of  (Xj.Yj)  depends  solely  on  the  positive 
parameters  Xj,***,!^;  also,  moments  and  product  moments  of  all 
orders  exist.  He  showed  that  there  is  a  sphere  in  the  ra- dimensional 
space  of  vectors  having  coordinates  (u10> •  ••  ,un+1  o»“*>  wn+l  n+P 
such  that  these  product  moments  are  generated  by  a  X-model  in  which 
*1  >  *n  t^iese  circumstances,  he  proved  that  the  equation 


G  (z, 0)  =  1 


(6.2.7) 


has  m  distinct  roots  z^(9),***,  zn(0)  which  are  analytic  functions 
of  the  complex  variable  8  in  some  neighborhood  of  0.  Smith  found 
z^fO)  *  0  and  for  0  in  a  sufficiently  small  neighborhood  of  0, 


R{Zj(9)}  < 


j  =  2,3, • • • ,m 


(6.2.8) 


Thus  from  Smith’s  results,  we  know  there  is  an  m-dimensional 
sphere  in  the  space  of  vectors  (u^,***,  cn+l,0,‘“*  ’Vl  n+l"1 
such  that  these  moments  are  generated  by  an  appropriate  X-model  having 
the  properties  already  outlined.  Let  Zj(9),**«,  zn(0)  be  the  roots  of 


5  (z, 9)  *  1. 


(6.2.9) 


In  this  case  we  can  expand  (z)  in  partial  fractions  when  0  is  in 
a  suitable  neighborhood  of  0; 


NeV) 


w-F*(z) 


(z-a) (1-C  (z,0)] 


m  Z.(0) 

l  — i— 

j=l  z-z^(9) 


(6.2.10) 
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where 


Z.(0)  * 


«-F*(z.(8)) 


(6.2.11) 


(z. (9)-o)  n  (5. C0)-zvC0)) 

3  k»l  3 

k/j 

Note  that  for  9  in  a  sufficiently  small  neighborhood  of  0, 
R{z.(0)}  <  for  j  *  1,***,  m  and  z.(0)  t  z.  (0)  for  j  /  k. 

1  *  3  K 

We  can  easily  invert  N0(z)  to  find 

n  z.(0)t 

N0(t)  *  ^  Z..(0)e  3 


(6.2.12) 


But  since  R{Zj(0)}  <  -X^~  for  j=2,3,***,m,  we  can  conclude  that 

2.  (9)  t  "tX..  ffi  2  li) 

N0(t)  =  2^0)6  1  +  0(e  1  )  (6.2.1  j) 

where  the  0  term  can  be  shown  to  be  uniform  for  all  sufficiently 
small  | 0 |  . 

Therefore 


KQcCt)  =*  log  M0c(t)  *  log  N0(t)  -  log  Ee 


-  -aC  -tX 

*  Zj (0)t  +  log  Zx (9)  -  log  Ee  1  +  0(e  ).  (6.2.14) 


This  shows  that 


knc(t>  ’  V  *  Bn  *  °<e  > 


(6.2.15) 


whenever  fi(x,y)  is  based  on  an  appropriate  X-model.  The  constant 


An  is  from  the  expansion 

V9)  •  i 

1  j-l  3  3* 


(6.2.16) 
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while  B„  is  from 
n 


log  Z 


,(«)  «  6  ♦  l  B. 

1  0  J  Jl 


(6.2.17) 


Theorem  6.2 

Suppose  F  s  C  and  n  is  a  positive  integer.  If  a  <  « 

n+p+l  ' 

ElYjl  <  *»  and  EX^  P|Y1|S  <  •  for  r  +  s  s  n  M,  r  s  n,  s  s  n,  and 
p  £  0,  then 

k„c(t)  *  V  *  5n  *  0(t"P>- 

\  and  ®n  are  rational  functions  of  ilj,***,  un+1>  *  ,•••,  *  and 
urs  for  r  +  s  s  n  +  l,  s  s  n,  and  r  s  n. 


Proof : 

From  equation  (6.2.S)  we  have 

knc(t)  *  V"  *  52t"'1  ~  —  s„.l  * 

and  we  know  the  <5's  are  determined  by  their  values  in  any  sphere. 

Thus  it  is  enough  to  consider  the  5's  resulting  from  a  sphere  whose 

points  are  generated  by  a  X-model.  But  in  such  a  sphere,  5 

1  n-1 

vanish  identically  and  the  values  of  6^  and  are  given  bv  equations 

(6.2.16)  and  (6.2.17).  This  proves  the  theorem.  j 

6.3  THE  DERIVATION  OF  A  and  § 

——————— - n - n 

Smith  found  that  if  W(t)  is  a  proper  Type  B  cumulative  process 
generated  by  a  X-model,  then  kn(t),  the  nth  cumulant  of  W(t),  is 

-u-1 

kn(t)  *  Ant  *  B„  ♦  «(•  1  ) 


where  the  generating  function  for  the  An's  is  precisely  (6.2.16). 
Thus  to  find  A^  we  need  only  refer  to  Smith  (1979)  and  assume  the 
joint  distribution  of  (X^.Y^)  is  G(x,y) .  However,  Smith  assumed 
EYj  ■  0  when  deriving  As  we  wish  to  avoid  this  assumption, 

we  rederive  these  coefficients. 

„  * 

Since  z^©)  is  a  root  of  the  equation  G  (z,9)  =  1,  we  have 


i©Y-z. X  -  . 

0  «  £[e  -1]  .  £  l  [ieY-^X]11 


l  -JrH[i0Y-5  X]n  . 
n*l  n*  1 


(6.3.1) 


QO  (  J 

Using  the  expansion  z  (9)  =  £  A.  ,  we  find 

1  j*l  J  3‘ 

o  *  (19)^  -  a  I  A  ^  (i9)2  -  (ie)a  l  a  iiili 

j*l  3  3'  j=l  :  3‘ 


2  rr  2 


.  A.A.  A_z 

i  3  e  w  n  / .  -\4 


+  -f  [A1‘(i9)-+A1A,(ie)J  ♦  (-V-  +  -f-)(ie)  +•••] 


3  4 


mi3  _  hi  2  ? 


♦*3^-  -^Cifl)^  A 

0  *■  j»l  J  J*  z 


3A  2a, 


A1A2(i9)3+-..]  -  3f[A13(i9)3  *  ( i © ) 4  ♦•••]  * 


A.  +  4=-  (ie)2[A ,2(i9)2  +•••] 


From  equation  (6.2.10) 


2.(9)  -  lim  [z-z.(9)]N  °(z) 

1  r-^i1(9)  1  9 


[u>-F*(z) ]  [z-z. (9)] 

=  lira  - 7 ± - 

z-^O)  (z-o)  [1-G  (z, 9) ] 


a»-F*(z  )  z-z  (9) 

- - L -  am  -f - - - 

z^o  z+Zj  fi  (z1,9)-G  (z,9) 

u)-F  (z.)  . 

- —  [  -r—  1 

z.-o  -  K(  9) 


(6.3.3) 


where  K(9) 
(1979). 


^e*(s,9) 


s*zx(9) 


is  as  in  equation  (4.13)  of  Smith 


We  expand  the  two  factors  in  (6.3.3)  separately. 


F  (z^-w 

1 — to 


o  t  1  -to  . 
o-Zj  *  a 


(6.3.4) 


As  the  generating  function  for  the  Bn's  is  based  on  a  X-model,  the 
distribution  function  F  has  moments  of  all  orders.  We  can  write 


F*(Zj) 


i-Vi 


♦ 


(6.3.5) 


1  -  0, 


J 


l  A 
■1  3 


j! 


.22  t 

♦  ii9)  +A1Aj(i9j  +(— -j~-  + 


V, 

4  ; 


Therefore 


?  (i8)j 

- ; -  *  )  a.  — 

1’“  j*0  J 


where 


“o  *  1 


5 1*2  "2*12 
l  1-0)  1-0) 


qiA3  3C2A1A2  S3A1 

1-0)  1-0)  1-0) 

-  -  -  2 
qiA4  4q2AlA3  302A2 

1-0)  1-0)  1-0) 


6C3A12a2  S4A14 

1-0)  1-0) 


It  follows  that 


r  (2.)-0) 
i~  1 

00 

_  Y  « 

j-1  J 

cl*i 

1-0) 

UXA2 

-5  2  - 

W2A!  W 

1-0)  " 

1-0)  ^ 

3°2A1A2 

1-0) 

1-0) 

30^2^  3 

*i\ 

(l-«)2 

(1-w) 

2a  2 
.  *1 

.-o))2 

°3A13 

1-0) 


3812*1*2 

(1-a)2 


(6.3.6) 
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°1^4  4ii2^1^3  ^2^  6£i3^12^2 

a. '  * - - -  ♦  - ; -  ♦  — r - : -  +  — : - 

4  l-o)  1  -0)  1-u  l-o)  l-o) 

30 i 2A22  18u10^A12A2  302^A14  40j2AjAj 

(l-o))2  (l-o))2  (l-o)) 2  (1-u))2 
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A  2A  2 

__2  3_ 

a  2 
a 

A,  6A1A_  6A..  3 

—  +  - =—  +  - =■ 

c  2  3 

<r  a 

A.  8A.  A,  6A-2  36A. 2A-  24A.4 

_i  +  -LA  +  _JL  + _ L_1  + _ L_ 

o  2  2  3  4 

a  a  a  a 


Since 


-  i  *  y  a  41221 

*3  3'-  ’ 


,  UAL 


-  X  a.*  J4 
J=i  :  J 


(6.3.8) 


where 


^  V 

0  +  c2 

A3  3AjA^  2A^3 

__  +  j-  +  ~ 

o  <7 

A.  4A.A,  3A  2  12A  2A-  6A.4 

jt  +  -1  3  4  _ —  +  1  2  + 

<7  2  2  3  4 

o  <7  a  <7 


Combining  results,  we  find 


u-MS,) 


"  *  '■“l'  *  '•‘■w c  1. 

lo*  (  2,-o  3  *  losC-T^ — 3  *  l0g(T-T‘)  * 


(6.3.9) 


3=1 


cy-^-iogc^) 


where  '  3  °j'  +  S j *  by  equations  (6.3.6)  and  (6.3.8). 


We  must  also  expand  -K(0)  in  powers  of  i9.  From  Smith  (1979), 
p.  40,  we  have 


-K(0)  = 


*  [- Zj  C©) ] 


j-1 


3=1 


(3-D!  ’j 


y,(e) 


(6.3.10) 


where 


V8)  *  \  ”*T  (l9’n 

J  n=0 


(6.3.11) 


Thus 


-g(e) 

Oi 


1  *  ^pn(ie)  +  ~T~  (ie)2  +  "lfCie)3  +  -lf(ie4>"'} 


•  ^[ii20+ii21(i9)+  -T'W2  +  -ffci0)3**  •*]  [Ax  (ie)  + 


‘1 


• 


*3  ^TT  +  *4  ^  +-1}+  2b[h0+*Zl^  +  T^2’ 


25, 


[A12(ie)2  ♦  A1A2(i9)3+(^-  +  ^-)(i0)4+...]} 


3A  ^A 

6T  Hfl40^41(ie)  +  ---][A13(i9)3  ♦  ■  K  2  (iO)4*  *  *  *  ]  ) 


(6.3.12) 


>  *• 
j*0  J 


where 


k0  =  1 


ki  *  a1[wir02^i] 


1  r. 


k2  *  u1[ai2'°2n2  "  2p21Al  +  °3A1  1 


1  r. 


3  *  a7[fl13-02A3  "  3*21A2  •  3022A1  +  3*3A1A2  +  3p3lV  Vl 1 


k4  =  '  4C21A3  -  6i322A2  '  4*23A1  +  4°3A1A3 


„  r  2 


♦  3=3*2*  *  12=31*1*2  *  6032*12  -  6Vl2'2  *  4»4lV 


T  3  .  r  4. 


Therefore 


i°g[- 


l  k.'  ii|2i 

j-l  3  3; 


ki'  ’  sr^ir^V 
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V  *  a  t°12~U2A2  '  2°nAl  +  C3A1  ^  ,  2^11  '  2Slia2^1+C2  A1  ^ 
1  U1 

k3*  =  ^[i313-p2A3  •  3i321A2  -  3D22A1  +  3°3A1A2  +  3°31A12  '  Vl^ 


-  7^*11*12-  C11°2A2-  2Clie21Al*  ail03Al2'  012°2A1 
U1 


U2  AXA2  +  2U2U2JAJ  -  U 2 i^Aj  ] 


*  r3tan3  -  ^llVl*  3SnV  -  °2  V1 

“l 


k.'  =  4k.  -  3k_2  -  4k. k.  +  12k  2k-  -  6k.4. 
4  4  2  13  12  1 


Returning  to  equation  (6.3.3),  we  have 
o)-F*(z.) 

log  Z^e)  *  log(  i  g l-)  -  log(-K(6)) 


=  l  C ♦  log(~~~)  -  log  (-2^^-)  - 


1  1 


logCOj) 


=  l  §.  -^4^-  +  iog(^) 

tZi  J  l!  ou. 


(6.3.13) 


and 


B.  *  C.'  -  k.' 
1  J  J 


6  . 

1  1-0)  0  Uj 
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5  pl*2  t  p2^12  gl  V  ,  *2  ,  V 

°2  ~  1  “Co  l-a>  ,..  ,.2  a  2 

(1-oj)  a 


-02A2-  202jA  *  0  A  2]  .  f2[0ll2-  2Sn°2*l*ii22  i 
1  U1 


B3  * 


*1*3  ^  JS/jAj  03Aj3  SC^AjAj  SSjO/j3 


1-U)  1-0)  1-0) 


(1-0))2  Cl-oi)2 


2013A13  A3  3AxA2  2A^ 


(l-«) 


3  a 


'  hhf^S-  302lV  3S22A1*  353S1'V  3531A12- 


*  A[Sll012-°nS2V  2S11°21*1  *“ll53Al2-°12C2Al* 
“l 


.  202021a12-02c3a1!]  -  -^j[i!n3-  30n2«2V  ^u^VW1 

“l 

Values  of  §n  for  n  s  4  can  be  derived  by  careful  arithmetic. 

As  a  check  on  our  derivation  of  A  and  B  ,  we  compute  their 

n  n 

values  for  the  special  case  Y ^  =  1 .  The  formula 


k (t)  *  At  +  B  +  o(t’p) 
nc  n  n 


should  then  reduce  to  the  formula  for  the  nth  conditional  cumulant 
of  N(t)  found  in  Chapter  5. 


>* 


Pc 


R 


« 
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When  Y.  :  1,  ils  »  1  for  all  s  and  0rs  =  0r*  The  first  three 

A  *s  reduce  to 
n 


and  the  first  three  B  's  are 

n 


.  a  *  4- 
1  0l2  °U1 

20 


2-ai 

1-u 


2 
,  4 


8023 


41 

30, 


3  u2  .  1  1  .  u2 

T  "  7?  127T  "  —  +  — 


U) 


‘1 


7°2°3  ,  _^4  ,  3»2 


aOj  ovj 


60. 


(!-«)' 


.-i.i!3- 

.3  2.  4 

U1  °  yl 


-5  .4 

W1  yl 

30 


“  5  _  4 

°W1  *1 


.  4 

°Vl 


2  H2 


.3,2 
aVl  W1 


3.  3 
a 


2,  2 
a  U1 


0t3l  (l-u») 3  (1-u)2  1‘“ 


Thus  we  have  that 


qn+p+l 


<  »  and  F  £  C 


a)  and  n  »  1,  then 


We  concluded  that  the  statement  is  true  if 


H.t 

E[W(t)|A(t)-l]  -  -±-  -  o(/t). 

yl 

The  assumption  that  <  *  and  *2  <  "  i®plies  EX^  1 Y ^  |  <  •;  if  we  also 

suppose  that  F  e  C  and  W(t)  is  a  Type  B  process.  Theorem  6.2  yields 


E[W(t)|A(t)*l]  =  Ajt  +  §1  +  o(l) 


Since  A^  *  -r—  ,  the  result  is  true  for  these  special  cumulative 


processes . 


Of  course,  if  we  are  willing  to  assume  more  about  the  moments 


and  product  moments  of  (X^,Y^),  we  can  specify  the  error  term  much 
more  precisely.  It  is  worthwhile  to  note  that  A^ ,  the  coefficient 
of  t  in  Var[W(t) | A(t)*l]  under  the  conditions  of  Theorem  6.2,  is 


as  we  know  it  should  be. 


calculations. 


This  is  a  further  check  on  our 


CHAPTER  7 


PROCESSES  WITH  VARIABLE  DEFECTS 


Although  we  have  assumed  that  each  lifetime  has  the  same 
defect  1-u,  there  may  be  cases  in  which  it  is  reasonable  to  suppose 
that  the  defect  depends  on  the  number  of  lifetimes  preceding 
Let  {uk}  be  a  sequence  in  (0,1]  and  suppose  {X^}  is  a  sequence  of 
independent  positive  random  variables  such  that  P{X^Sx}  =  ukJ(x) 
where  J  is  a  proper  distribution  or.  [0,*)  and  J(0+)  <  1.  Note  that 


P{X1+X2St> 


<j)_J  (t-t)u>.  dj  (t) 
0  ^  L 


WjU>2>J 


(2) 


(t) 


and  in  general 

n  .  . 

P{S  St}  *  (  n  w.)Jinj(t). 
j-1  J 

It  follows  immediately  that 


(7.1} 


H(t) 


l  (n  uj.}JCn)(t) 
n*l  j»l  J 


(7.2) 


and 


od  n 

H(»)  ■  I  (  n  u.)  s  ». 
n«l  j«l  J 


If  the  uij's  are  not  bounded  above  by  some  u>  <  1,  it  is  entirely 

possible  that  H(«)  ■  ».  Also,  unlike  the  situation  in  which 


UK  £  u>,  the  probability  the  process  is  alive  at  time  t  does  not 
necessarily  converge  to  0.  We  find 


q(t)  *  P{A(t)  *  1} 


-  ft  n  ,  * 

-  «  [1-J(t)i  ♦  l  u  i [i-J(t-t)](  n  u»  )dj'-nj(T) 

1  n-l  '0  j»l  J 

-  I  C  n  u .)[J(n)(t)-j(n+1)(t)].  (7 

n»0  j«l  J 


Lemma  7.1 


q(t)  -  u.  -  I  (l-u^M  n  u)  )J(n5(t) 
n*l  j»l  J 


Proof: 


The  right  hand  side  of  (7.4)  equals 


«1  -  l  d-«n+l)(  n  uiHJ  (t) 

n*l  j»l  1 


(n)r..  T(n«-1) 


*'(t)] 


l  d-«n+ J(  n  u>.)J(n+1)(t) 
n*l  n  A  j«l  3 


-  I  (  n  «.)Uw(t) 

n*l  j*l  ^ 


(n),„,  T(n+1) 


iJ(t)] 


•  n+1  .  .  r  n  *  n 

♦  l  (  n  u..)[JlnJ(t)-jtn  1J(t)]  -  l  (i-u>  .)(  n  ui.)j 

n*l  *  nal  -is 
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I  (  n  w.)[JCn)(t)-jCn+1)(t)]  ♦  {o).j(t) 
=0  j=l  3  1 


-  I  (  II  « .)[J(n)(t).j(n+1)ct)] 
n*l  j=l  3 


-  Id-v)(!I“i)J(n+1)w^ 

n=l  n  1  j=l  3 


-  q(t)  ♦  I  a.J  3  (t) . 


(7.5) 


Note  that  *  uij  -  =  0  and 


a.  *  -II  u.  ♦  II  oi .  -  (1-u),  )  II  u>.  = 
*  j-1  3  j*l  3  *  j*l  3 


Formula  (7.4)  shows  the  monotonicity  of  q(t)  much  more  clearly 
than  (7.3) . 

n 

Because  n  w.  is  nonincreasing  in  n,  it  converges  to  some  limit 

j-1  3 

I  2  0.  In  fact,  since  we  are  assuming  u>.  >  0  for  all  j,  l  is 

OB  3 

positive  if  and  only  if  £  (1-w.)  <  ®. 

j-1  3 

Lemma  7.2 


lim  q(t)  ■  lim  II  w.  =  l  . 


n-+®  jel 


Proof : 


q(t)  2  l  l  [JCn)(t)-J(n+1)(t)] 
n*0 


-  1(1-  lim  Jin;(t)]  -  l. 


(7.6) 
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Now  choose  e  >  0.  There  exists  some  N(e)  such  that  n  w.  <  l  +  e 

j»l  3 

Whenever  n  a  N.  Thus 


N-l  n+1  r  .  ,  n 

lim  q(t)  s  lim  J  (n  «.) [JtnJ (t)-J^n*1J (t) ] 
t-*-  t-»-  n*0  j»l  3 


♦  lim  (t*e)  l  [J(n)(t)-J(n+1)(t)] 
t-*»  n»N 


s  lim  [1-Jl"j(t)]  ♦  t  ♦  e 

t-K» 


l  +  e. 


(7.7) 


Since  e  is  arbitrary,  lim  q(t)  =  l. 

t-*» 

Lemma  7.5 

<a>  n 

Suppose  I  (  H  w.)  *  «.  Then 
n*l  j«l  3 


P{A(t+s)  =»  l|A(t)*l}  ♦  1  as  t 


Proof : 


ao 

If  H  ui.  3  2,  >  0 ,  then  by  Lemma  7.2  lim  ^  *  1. 
j-1  3  t—  q(t) 


Suppose  then  that  lim  n  ui.  •  0.  We  will  first  show  that 
n-*»  j«l  3 

P{N(t)3k|A(t)*l}  0  for  fixed  k. 
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k+1 


(  n  u .)[J(k)(t)-j(k+1)(t)] 
i»l  3 


P{N(t)-k|A(t)-l} 


»  n+1 

l 

n*0 


l  C  H  u.)[J(n)(t).J(n+1)(t)] 
■0  j«l  3 


J(k)ft)  -  J(k>1)rti 


l-J(k+1)(t)+  l  (  n  o..)[J(n)(t)-JCn+1)(t)] 
n*k+l  j=k+2  3 


Observe  that 


m-1 


1  -  (1-V2)  *  l  (I-,)  S  n  •  1,  2. 

m*n+3  p=n+2  ^ 


n 


since  lim  H  u>.  *  0.  Hence 
n-**>  j*l  J 


n+1 


(  n  u>.)[J(n)(t)-J(n+1)(t)] 
j*k+2  3 


■  [Jtn)(t)-Jtn*l)tt)]{(i-»  )(  "51  „.)*  I  (i- 

jak+2  3  m=n+3 


[J(n)(t)-J(n+1)(t)J  l  (1-u  )  V  0,. 

m*n+2  m  j»k+2  3 


Thus  it  follows  that 


n+1 


l  (  n  w.)[JCn)(t)-j(n+1)(t)] 

n«k+l  j«k+2  3 


(7.8) 


m-1 

)  n  oj 

p=k+2  p 


(7.9) 
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-  I  [J(n)(t)-jCn+1)(t)]  l  (l-o)  )  "'n1  to 
n*k+l  m=n+2  j=k+2  ^ 


«  m-1  m-2  . 

*  l  (i-o)  )(  n  0)  )  l  [J(n)(t)-J(n+I)(t)] 
m=k+3  j  =k+2  ^  n=k+l 


=  l  (l-o,  )  (  n  0)  )[j(k+1)(t)-j(,n"1)(t)]. 
m*k+3  m  j=k+2  J 


Also, 

00  [JJ.  J 

1-J(k+I)(t)  *  [i-j(k+n(t)]{i-0).  ♦  l  (1-0 ij  n  0) 

K  ^  m*k+3  m  j=k+2 


Therefore , 


l-J(k+1)(t)> 


n+1 

n 

n«k+l  j*k+2 


I  ( 


«.)[J(n)(t) 


-J(n+1)(t)] 


»  (l-o^+2)[l-J(k  13 


•  m-1 

(«)]♦  I  (l-o,J(  n 

m«k+3  m  j»k+2 


o).)[l-J(m’ 


and  we  have 


P{N(t) «k | A(t) -1 > 


d-v  I  (l-VlH.  J  “jld- 

m»k+2  j»k*2  J 


(7.10) 


(7.11) 

(t)] 

(7.12) 

J(m)(t)] 


Now  define  a  *  [r— H 
m  lk+lJ 


rm-v  (®_(^+i))  rv .  n 

JC  }(t)  s  J  m  (k)  s  [j(k  15  (t 


and  thus 


l-JW(t)  s  l-[j(k+1*(t)] 


Combining  (7.12)  and  (7.13),  we  see 


P{N(t)=k | A ( t ) = 1 } 


(i-a).+.)+  I  (!-»_.)(  n  . [J(k+1)(t)]  m  } 


L  V*  '"mi  1  >  \  »  "i 

n=k+2  1  j*k+2  J 


(7.14) 


Note  that 


•  n  *  m 

l  (l-w  . )  (  II  o).  )a  >  c  l  m(l-u)  .)(  n  a>.) 
m*k+2  m"1  j»k+2  3  m  m-k+2  m+1  j-k+2  J 


for  some  c  >  0.  But 


1S4  - 


00  m  <*>  m 

l  “d-'ViH  n  <*».)  *  (k+i)  l  (1-03  ) c  n  ».) 

m*k+2  m+1  j=k+2  3  m=k+2  m+1  j=k+2  3 


m 


*  m-k-1 

l  l  Cl*Vl)C  11 


m=k+2  £=1 


j=k+2 


00  m  oo  <x>  in 

=  (k+i)  l  (l-co  (  n  oj .)+  I  l  (i-o3  )  n  u.  . 

m=k+2  ra+1  j=k+2  3  i=k+2  m-£  ra+1  j=k+2  3 


( 7.15 ) 


Now  since 


j*l 

and  so 


n  oo  mi 

n  o»  I  (i-«  ,)  n  <*>.=  n  w. 

3  m+1  j*k+2  3  j*k+2  3 


I  11  ^)-(k+l)  l  ^-Vl)(.  ?  ,wj} 


m=k+2 


m+r\  .  _  y 

j=k+2  J 


00  l 

l  (  n  u.)  - 

£»k+2  j=k+2  3 


by  assumption.  Therefore 


lira  P{N(t)=k]A(t)*l}  *  0, 

t-WO 


m=k+2 


j=k+2 


(7.16) 
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Now  we  use  this  fact  to  show 


lim  =  1  for  fixed  s. 

t—  q(t) 


Choose  e  >  0  and  fix  s.  There  exists  some  N(e,s) 
,  »  <*>  n 

all  n  £  N,  1-  JLn;(s)>l-e.  Also,  since  [  (Hu.) 

n=l  j=l  J 


and  there  is  some  K(N)  making 


such  that  for 


»,  0).  -*>  1 
3 


k+l+N 

n 

j=k+l 


whenever  k  2:  K. 


qCt+s)  P{A(t+s>l,N(t)<K}  P{A(t+s)=l,N(t)>K} 

q(t)  ‘  P{A(t)=l}  P{A(t) =1 } 


.  P{A(t+s)*l ,N(t)£K}  P{N(t)>K,ACt)=l) 
~  P{N(t)iK,A(t)«l}  P{A(t)=l} 


We  already  know 


P{N(t)aK,A(t)«l} 

P{A(t)»l> 


and  now  consider 


P{A(t+s)»l,N(t)aK}  =  l  P{A(t+s)=l,N(t)=n} 

n=K 


*  l  P{A(t+s) =l|N(t)=n,A(t)=l}P{N(t)*n,A(t)*l} 
n*K 


s  l  P{N(t) *n,A(t) =1 }P{A(t+?  +s)*l ]N(t)«n,A(t)*l} 
n*K 
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oo  oo  n+m+1  ,  » 

*  l  P{N(t)n,A(t)-l)  l  (  n  u>.)[JLmJ(s)-Jl  J(s)] 
n*K  m=0  j=n+l 


oo  N  n+l+N  ,  ■.  n 

>  J  P(N(t)*n,A(t)«l}  I  (  II  u>.)[JlmJ(s3-Jl  iJ(s)] 
n=K  m=0  j=n+l  ^ 


>  Cl-e)  l  PCN(t)=n,A(t)=l}[l-JCN+n(s)] 
n=K 


>  (l-e)2P{N(t)SK,A(t)®l) . 


(7 


Hence 


Since  e  is  arbitrary  this  proves  the  result.  □ 

In  Chapter  3  we  learned  that  if  J(x)  e  S,  the  class  of  sub¬ 
exponential  distributions,  and  if  P{X^Sx>  =  ojJ  (x) ,  then 
lim  s  1.  Our  next  lemma  generalizes  this  result. 

Lemma  7.4 

Suppose  u  s  u)  <  1  for  all  n  and  J(x)  e  S*  Then 


lim 

t-x» 


q(t+s) 

q(t) 


l. 


18) 
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Proof: 

Since 


•  n 

“n  S  “•  1  *  1  "  “i  +  Ii(1-“n+i)(  n  Wj) 


or 


os  n 

=  I  a-n+1)(  n  “J 

j=l  J 


n=l 


(7.19) 


Combining  (7.19)  and  expression  (7.4)  for  q(t),  we  discover 


n 


q(t)  *  I  (i-«  ,)(  n  u>  )  [i-j(n)  (t) ] . 

n=l  j  =  l  J 


(7.20) 


Hence 


limac^fl 

t— 


11  l-JCnj(t+s) 


jl-J(t+s)(  J  n=l  n  1  j-l  J  1'J(t  s) 
"  (  l-J(t)  j 


n  -1-J(n)(t). 


(7.21) 


By  Lemmas  A,  B,  and  C  in  Chapter  3f  we  know  that 


l-JCfs)  ,  l-JW(t) 
l-J(t)  Af  l-J(t)  11 


and  for  any  e  >  0  there  is  some  D(e)  <  »  making 


l-JCn) (t) 
l-J(t) 


SD(l*e)n. 
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K 


a 


i 

Thus  if  we  choose  e  to  make  u(l-e)  <  1, 


ao 


l  Ci- 

n=l 


u> 


n+1 


n 

)C  n  «.)[■ 
j-1  3 


l-J(t)  J 


*  D  l  (l-a.n+1)[a)(l-£)]n  <  - 
n=l 


and  the  Dominated  Convergence  Theorem  implies 


lim 

t-*» 


CO 

I  (l-o) 
n*l 


n+1 


)(  n  «.)[■ 

j-1 3 


1-J(n)(t)1 
l-J(t)  J 


n=l  3=1  J 


Therefore 


lim 

t+® 


q(t+s) 

q(t) 


1. 


(7.22) 


n 


The  next  lemma  generalizes  Lemma  3.1. 

Lemma  7.5 

Suppose  u)^  s  u)  <  1  for  all  n  and  J  e  S  .  Then 


k+1 

n  u>j 

lim  P{N(t)-k|A(t).l>  •  - 

I(I  «,) 

n=0  j*l  J 


Proof: 

When  J(x)  e  S, 


j(k) 


(tw(k*1}(t) 

(t)-J(n+1)(t) 


l-J(t) 


col  r  i-j(o 

J  LJ(n)(t)-J 


m 
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The  Dominated  Convergence  Theorem  applies  to  the  denominator  of 

(7.24)  and  the  result  follows.  □ 

00 

We  will  consider  some  of  the  consequences  when  II  u>.  »  l  >  0. 

j=l  3 

As  noted  earlier,  for  this  product  to  be  nonzero,  the  iu.’s  must 

00  ^ 

approach  one  quickly  enough  to  make  £  (l-u>.)  <  •.  It  is  easy  to 


see  that  when 


j-1 


l  >  0,  lim  P{N(t)=k| A(t)=l)  *  0  for  all  fixed  k. 

t-*» 

Thus  if  the  renewal  process  is  alive  at  some  time  t  and  t  is  large, 
then  with  high  probability  the  process  has  survived  many  lifetimes; 
intuition  suggests  the  future  development  of  the  process  will  be 
much  like  that  of  a  process  whose  lifetimes  have  proper  distribution  J. 


Lemma  7.6 


Suppose  n  a).  *  l  >  0.  Then 

j-1  3 


E[N(t+s)-N(t) |A(t)*l]  -  [HjCt+sj-HjCt)]  0  as  t 


Proof 


I  (  n  «.)[J(n)(t*s)-JCn)(t)] 

E[N(fs)-N(t)|A(t)=l]  =  BiLlzi - — - .  (7.26) 


q(t) 


Fix  e  >  0.  There  exists  an  N(e)  such  that  whenever  n  a  N, 


H  u .  <  Z  +  c .  Thus 
j-1  3 


E[N(t+s)-N(t) |A(t)*l] 

T[J(B)(t*s)-J(n)(t)]  +  (l*e)  l  [J(n)(t+s)-J(n)(t)] 
n»l _ n=N _ 

l 


«  0(1)  +  [HJ(t+s)-HJ(t)][l  +  f]  .  (7.27) 

Similarly, 

»[H ,(t+s)-H T(t)] 

E[N(t+s)-N(t)|A(t)-l]  >  - - - - -  .  (7.28) 

l  +  o(l) 

Therefore  the  result  follows.  □ 

In  order  to  study  more  general  questions,  suppose  G(tj  is  a 
natural  process  depending  on  the  defective  random  variables  Xj, 
X2'",.XN(t)+r  Let  Fi(x)  *  u.J(x)«P(Xi^x).  Then 


EG(t)A(t) 


l 

n*0 


(N(t)*n) 


G(t,x 


1* 


•dF  .  (x  .) 
n+1  n+1 


<*>  r  n+1 

*  \  Lm  GCt.x—  ,*  )(  n  „ 

n*0  J (N(t)*n)  j»l  J 


N(t)+1 

-  EjG(t)  (  n  0)  )  (7.29) 

j«l  3 


where  ET  indicates  integration  with  respect  to  the  proper  distribution 
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Taking  G(t)  s  1,  we  find 


N(t)+1 

q(t)  ■  Ej(  II  «.) 

j«l  3 


(7.30) 


E[G(t)|A(t)-l] 


N(t)+1 

E.G(t)  (  H  a)  ) 

-  3 

NTt)+l 

et(  n  u.) 

J  j»i  3 


(7.31) 


Lemma  7.7 


Suppose  | G(t)  |  s  M.  If  H  a).  *  Z  >  0,  then 


E[G(t) | A(t)  *  1]  -  EjG(t)  ^  0  m  t  f 


Proof : 

With  no  loss  of  generality,  we  may  assume  that  G(t)  £  0.  Choose 

n+1  e 

e  >  0.  There  exists  an  N(e)  such  that  if  n  i  N,  |  n  u.  -  Ji|<  jjp*. 

j-1  3 


Let  Bt  ■  (N(t)  2  N). 


By  assumption. 


N(t) +1 

EJ[G(t)(  n  U).)] 

j»l  J 

N(t)+1  N(t)+1 

*  E_[G(t)  (  n  u».)x(Br)  ]  ♦  E.[G(t)(  n  u  •)x(Bf.C)] 
J  j-1  3  Z  J  j«l  3  Z 


N(t)+1 


E.(G(t)(  H  mJxCBJ]  ♦ 
J  j-1  3  1 


0(1). 


(7.32) 


63  - 


Also, 


N(t) +1 


IEjIGCOxCB^IsEjIGOOC  ^  Wj)x(Bt)]S  IEjIGWxCB^]  + 


and 


N(t)+1 

Et(  n  m.)  •  l  +  o(l)  as  t 
J  i-i  1 


(7.33) 


(7.34) 


Therefore, 


N(t)+1 

E,[G(t)(  n  ».)] 

i -i  3 


Ejt  n  -  ) 

3-1  J 


s  Ej  [G(t)  ]+  e.  *  o(l) 


(7.35) 


As  e  is  arbitrary,  the  lemma  is  proved. 


Applications  of  Lemma  7.7 


Let  u.  (J)  «  xndJ(x).  Suppose  W(t)  is  a  cumulative  process 
J0 

based  upon  {(X. ,Y.)}  where  X.  ~  u.J  and  ETY  «  k  (J) .  If  <  (J)  <  < 

i  i  xi  j  r  i 

and  Uj(J)  <  »,  then  let 


«,(J) 


««•*( 

00 

If  II  w.  *  l  >  0,  it  follows  that 

J-l  J 

<,(J) 


•c,  CJ) 
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and  hence 


■c,  (J) 


1  >  e|A(t)  *  1}  -*•  0  as  t 


(7.36) 


If  <2  (J)  <  •  and  i^C*!)  <  “»  define 


•e,(J) 

7TW1 


/w(t)  •  ^ 
\~W 


IfiTW 
<,  (J) 


1'-  ^  2 

where  "  u  ^  X^]  .  Lenina  7.7  implies 


«,(J) 


S  a  I  A(t)*l  1  -►  4(a)  as  t  +  ■ 


(7.37) 


whenever  H  u.  *  l  >  0. 

3*1  3 

Lemma  7.7  only  applies  to  bounded  natural  processes.  The  next 
lemma  gives  a  crude  indication  of  the  behavior  of  more  general 
processes. 


Lemma  7.8 

Suppose  G(t)  is  a  natural  process  such  that  EjG(t)x(N(t)sN) 
for  every  fixed  N.  If,  in  addition. 


n  ii).  *  i  >  o, 

3-1  3 
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E[G(t)|A(t)  -  1]  ~  EjGCt). 


Proof : 

Again  we  may  assume  G(t)  2  0.  Choose  e  >  0.  There  exists 
n+1 

some  N(e)  such  that  |  n  <  e  whenever  n  2  N.  Let 

j»l  J 

Bt  -  (N(t)  *  N}. 


N(t)+1  M(t)+1 

E  [G(t)(  n  «,)]  -  E  [G(t)(  n  0)  )x(B  )] 
j*l  J  j=l  J 


N(t)+1 

+  E  [G(t)(  n  a3.)x(BtC)]. 

J  j*l  J  r 

Again 

N(t) +1 

E-[G(tH  n  0>  )x(B  C)]  S  ETG(t)x(BtC)  =  o(l) 
J  t*l  J  1  J  Z 


by  assumption. 


N(t)+1 

AEjlGCOxfB^]  S  EjEGCt)  c  0>.)x(Bt)]  £  (t+e)Ej[G(t)x(Bt)] 


and  thus 


N(t)+1 

£E  [G(t)]  +  o(l)  S  E.[G(t)(  n  »  )]  s  (l*«)ET[G(t)]+o(l). 

J  J  j-i  J  J 


The  result  follows. 


□ 


166  - 


X 


N 


P? 


Application  of  Lennna  7.8 

k  °° 

Suppose  G(t)  *  N(t)  .  If  H  u).  *  £  >  0,  then  Lennna  7.8  implies 

j»l  3 

E[N(t)k | A(t)  =  1]  ~  EjN(t)k.  (7.38) 

If  iij^GJ)  <  •»  this  indicates 

E[N(t)k|A(t)  =  1]  =  ctk  +  o(tk). 

Of  course,  as  we  indicated  earlier,  the  assumption  that 

OB 

H  <*>.*£>  0  is  a  very  strong  one.  Rather  than  assume  u.  -*■  1  with 
j*l  ^  3 

a  certain  speed,  it  may  be  more  reasonable  to  suppose  that 

u»j  w  <  1.  As  before,  let  Fj  (x)  *  ukJ(x)  =  P{X^  s  x).  If  there 

exists  a  a  >  0  making 


eoxdJ(x)  =  1 


then 


(7.39) 


dF.(x)  «  eaxdF.(x)  »  ue-dJ(x)  =  dF(x) 
J  J 


(7.40) 


defines  a  proper  distribution  F(x). 

Let  G(t)  be  natural  and  let  £  indicate  integration  with  respect 
to  the  proper  distribution  F(x).  Then 


EG(t) 


G(t,x. 

n»0'(N(t)«n} 
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•  t  n+1  OC 

I  G(t,x. ,  * •  * »x  . )  (  n  -7-)effte  zdfAx.)  — 

n-oJ{N(t)-n}  1  n+1  j-1  “j  1  1 


dF  ,(x  .) 

n+1  n+1 


and  thus 


-ot-  N(t)+1  “j 

e  °  tG(t)e  n  -jjL)  -  EG(t)A(t) 

j»l 

-at  -  "ah  N(t)+1  “i 
q(t)  »  e  ax  Ee  r(  n  -J- ) . 

j  =  l 


Therefore 


(7.41) 


(7.42) 


E[G(t)|A(t)-l]  * 


-at  N(t)+1  a). 
EG(t)e  *(  n  -1) 

_ 3*1  M 

-o?  N(t)  +1  a>. 

ie  Z(  n  -f) 

3*1  w 


(7.43) 


Lemma  7.9 

00  0) . 

Suppose  II  *  2,  >  0.  If  there  is  a  a  making  dF(x) 

1*1  r 

a  proper  distribution,  and  if  p  *  xdF(x)  <  ®  ,  then 

1  Jo 


u>eaxdJ  (x) 


-a?  N(t)+1  u.  * 

Ee  l(  H  -J-)  •+  =  ti(  (a)  as  t 

j»l  “  °V 


Proof : 


-a?  N(t) +1  u. 

Ee  Z(  n  -f) 

j-1  “ 


(7.44) 


^fe-^dF(x)+I(n;1^)fT 

“  't  n*l  j-1  u  ^ 0  t-T 


e-a(y+T-t)df(y)df(n)(x) 
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Choose  e  >  0.  There  exists  an  N(e)  such  that 


in+1  m.  I 

n  -  l  <  e 


whenever  n  £  N. 


-o?  N(t)+1  w. 
Ee  (  11 

j-1  “ 


a),  ,  ...  N-l  n+1  u.  rtr00 

r  e-o(x-t)df(x).  j  ( „  .I, 

“  't  n«l  j.l  “  JCHt-T 


e-a(y.T-t)df(y)d-tn)(T) 


♦  U+e) 


z  i  r 

n=l  ■'0  ^t-T 


e-»(y.T-t)df(y)df(n)(t) 


(7.45) 


-a?  N(t)+1  u>.  a) 

lira  Ee  n  -^)  s  lim  ~  [l-F(t)] 

UJ  0)  J 

t-*«  j-1  t-H» 


N-ln+lai.  .  . . 

♦lim  Z  (  n  -f)[F(n)(t)-F(n+1)(t)] 
t-*»  n*l  j-1 


♦  (£*e)  lim 
t-*» 


im  i  r ' 

+"  J0  Jt-T 


e"a(y+T‘t)dF(y)dH(X) 


by  the  Key  Renewal  Theorem. 


(7.46) 


Similarly,  one  can  show 


-  -oz  N(t) >1  a).  . 

lim  Ee  i  n  -*■)  i  *>.  e' 
t—  j-1  *  ayl 


This  proves  the  result. 


Lemma  7.10 


Assume  the  proper  distribution  F  exists.  Also  suppose  G(t) 
is  a  sluggish  and  natural  process  such  that  for  every  e  >  0  there 
exists  some  A(e)  making 

£G(t)X(|G(t)|  >  A)  <  e 

oo  oj  . 

for  all  sufficiently  large  t.  Then  if  H  -2-  =  i  >  0, 

j-1  “ 

E[G(t)  i A(t)  =1]  -  EG(t)  -  0  as  t  ■*»  ». 


Proof : 

n+1  oo . 

Fix  e>0.  There  exists  some  N(e)  making  IT  — -  2,  <  e 

j»l  “ 

whenever  n  s  N.  Let  Bt  =  (N(t)  >  N}. 


-ot  N(t)+1  a; .  -oc  N(t)  +  1  id. 

Ee  rG(t)(  n  -i)  *  Ee  rG(t)X(BJ(  IT  ~f) 

.  ,  OJ  L  .  .  OJ 


,  “OCt  .  N(t) +1  w. 

♦  Ee  XG(t)X(BtC)(  n  -f). 

C  j-1  w 


But 


-at  N(t)+1  iij. 

I  Ee  rG(t)XCB. (  n  -i) !  s  M!EG(tV<(BrC) ! 

t  j-1  w  * 


m  u) . 

where  M  is  an  upper  bound  on  H  for  m-1,***,  N. 

w 


S  MEG(t)X(|G(t) |  >  A  )  ♦  MAP(BtC)  <  c 


(7.47) 


if  we  choose  A  correctly  and  if  t  is  sufficiently  large. 


1 
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Also, 


-a?  -or  N(t)  +  1  a). 

Ee  lG(t)X(B.)  £  Se  rG(t)X(B  )(  n  -f) 
t  1  j-1  “ 


r 

i 

[ 

i 

i 

■ 

K 


s  (£+e)Ee  wG(t)x(Bt). 


(7.49) 


Therefore 

-OQ  _  -a?  N(t)  +  1  oj.  -05 

-e+JlEe  u(t)  <  Ee  G(t)  (  n  -J-)  <  (Ue)Ee  G(t)+e 

j-1  “ 

(7.50) 

for  sufficiently  large  t.  Hence 

-o?. 


E [G(t)  | A(t)=l]  - 

‘•OVj] 


(7.51) 


by  Lemma  7.9  and  expression  (7.50).  Now  Lemma  4.5  implies 

E[G(t)  | A(t)  =  1  ]  -  EG(t)  -►  0.  □ 

This  lemma  allows  us  to  extend  several  of  the  results  in 
Chapter  4  to  the  situation  in  which  the  uk’s  are  not  necessarily 
identical  but  do  converge  to  some  u>  quickly  enough  to  make 

00  (Jj  . 

n  -2- 


0) 


l  .  For  example,  by  linking  Lemma  7.10  and  Theorem  4.1, 


j=l 

we  find  that  if  £^<  «o  and  “>  then 


(i)  P 


W(t)-<  N(t) 

II 

/ — \ 
♦-» 
v — / 

< 

) 

*(o) 


(7.52) 


and  if  <  00 


171 


(ii)  P 


W(t)- 


* 1 1 


<  a  |  Aft)  =  1 


Yt 

Si 


*(«) 


(7.53) 


Linking  Theorem  4.2  and  Lemma  7.10  yields 


Z.t  2 

E[(W(t)  -  -f-)  | A(t) 


if  $2  <  "  and  <2 


1]  =  +  o(t) 


(7.54) 


Thus  we  see  that  the  assumption  that  all  lifetimes  have  the 
same  defect  io  can  be  relaxed  somewhat  without  overturning  our 
results . 


APPENDIX 


Theorem  G 

Suppose  that  q  is  a  positive  integer,  m  2  0,  and 


1)  F  e  C  and  <  "• 

2)  J (t)  is  a  function  of  bounded  variation  on  [0,")  having 
m  +  q  absolute  moments  and  J  (s)  =  0(|s|^)  as  |s|  -*•  0. 


3)  V  (s)  is  defined  for  R(s)  >  0  by 


V  (s) 


J  (s) 
fl-P*(s) ] 


q 


*  * 
and  '?  (0)  is  defined  to  make  H  (s)  continuous. 

Then  ¥(t)  e  B(m),  the  class  of  functions  of  bounded  variation 

on  [0,«)  having  m  absolute  moments. 


Proof : 

This  theorem  is  a  special  case  of  Theorem  1  in  Smith  (1966) . 
Smith's  Theorem  is  couched  in  terms  of  Fourier-Stieltjes  transforms 
but  can  be  adapted  to  the  current  Laplace-Stielt jes  setting.  In  this 
instance  we  take  ■  y  =  q  and  M(x)  =  xm. 
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